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(57) A method for embedding a watermark into dig- 
ital data, when the watermark is to be embedded in a 
digital image, independently changes real number com- 
ponents and imaginary number components of each of 
coefficient values of a complex watermark coefficient 
matrix using key, from the watermark to be embedded 
in the digital image, a step for performing a discrete Fou- 
rier transform on the sequence matrix of the changed 
watermark and generating a watermark pattern: and a 
step for adding like tiling the water mark pattern to the 
original image, and generating an embedded image. 

Further more, a watermark detection method for de- 
tecting a watermark from a digital data, a step for sep- 
arating a block from an arbitrary position on the detected 
object image, a step for performing a discrete Fourier 
transform on the block and obtaining a sequence matrix, 
a step for generating position information for a compo- 
nent that is to be detected and that is specified by the 
key, a step for detecting a position marker sequence by 
calculating a phase difference of a sequence by an 
amount of parallel displacement, for each item of the po- 
sition information, and extracting offset information 
which is the amount of parallel displacement when there 
is agreement between a start point of an embedded wa- 
termark and a start point of the block cut from the de- 
tected object image, and a step for detecting the em- 



bedded watermark cut from the detected object image. 
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Description 

BACKGROUND OF THE INVENTION 

5 1 . Field of the Invention 

[0001] The present invention relates to a watermark embedding method, watermark detection method, a watermark 
embedding apparatus, a watermark detection apparatus, storage medium storing a watermark embedding program, 
storage medium storing a watermark detection program, a watermark system, and a integrated circuit, which, in order 
io to actualize copyright protection for digital content, change personal information content by a small amount that cannot 
be perceived, and embed watermark so that it cannot be perceived by person, into said content. 

2. Description of the Related Art 

15 [0002] In recent years, the transfer of digital content via networks has progressed and been facilitated by technologies 
(such as the JPEG ['Joint Picture Coding Expert Group'Jmethod for digital information such as voice, moving and still 
pictures. In addition, the distribution of content via networks has also begun to grow through information infrastructures 
such as the Internet. 

[0003] However, content that is distributed via networks is digital information and so it is easy to make perfect copies 
20 of personal content. In addition, with information infrastructures such as the Internet, all information users can become 
information transmitters and so there is copyright infringement through the making and selling of illegal copies. Fur- 
thermore, the increase in the processing performance of personal computers facilitates the processing and editing of 
image and voice data on personal computers, facilitating copyright infringement such as illegal secondary use and use 
that the authors had not envisaged. The current situation is that the growth of copyright infringement such as this makes 
25 authors hesitant about supplying information and thus obstructs the distribution of information via networks. 

[0004] In addition, separate from this, there is a problem from the point of view of content providers in that "even if 
one wishes to handle the rights to the content correctly, it is not possible to know where those rights lie if one considers 
the possibility of incorrect usage" and this also prohibits the reuse of content. 

[0005] As described below, copyright management/protection systems using conventional technologies have been 

30 proposed with respect to these two problems. 

[0006] Prior art relating to watermark technologies includes A. Piva et. al: "DCT-based Watermark Recovering with 
Resorting to the Uncorrupted Original Image." Proceedings of the 1 997 International conference on Image Processing 
(ICIP'97) (Ref. 1 in the following); Takao Nakamura. Hiroshi Ogawa, Youichi Takashima: "A Watermarking Technique 
for Stile Image, "NTT R&D Vol.47. NO. 6. 1998 (Ref.2 in the following); and Wisetsuit Piyapisuit. Kineo Matsui; "Block 

35 Characteristic in Color Image Watermaking Using Equivalent Signal Transform" National Conference of the Institute 
of Electronics, Information and Communication Engineers, D-11-42. 1999 (Ref. 3 in the following). 
[0007] The method of Ref. 1 performs an orthogonal transform of an original image size obtains a frequency compo- 
nent matrix, and changes a coefficient value of a mid-frequency band in the frequency component matrix to embed 
the watermark. Changing the coefficient value is performed by changing the contrast. This provides robustness with 

•to respect to irreversibel compressing and color change, and also with respect to changes in the contrast. 

[0008] In addition, with the method of Ref.1, when the watermark is read, an image which is to be investigated has 
the watermark read by inverse spread of the coefficient values of the mid-frequency band in the frequency component 
matrix obtained by orthogonal transform. Through this, it is possible to compare a magnification or reduction with digital 
content at the original size, align it with the original digital content and perform detection. 

45 [0009] In addition, with the method of Ref.1 . when reading is performed, an attempt is made using a random number 
used in the spectral spread and the read watermark is that for which the response is highest. This makes it possible 
to detect partial images and the like where it is not known where a cut portion lies on the original digital content. 
[0010] However, the above mentioned Ref.1 involves the following problems. 

50 I . There is a low robustness with respect to partial cutting. 

II. There is a large amount of processing involved for an orthogonal transform of an original image at the full size 
thereof, which causes a local degree of complexity. 

III. There is a great amount of image deterioration when the watermark is embedded. 

IV. Attempted reading is performed for all values obtained for the watermark when the watermark is detected. 

55 

[0011] With the method of Ref.2. an image is generally divided into large blocks of a block size used by non-reversible 
compression, an orthogonal transform is performed for each block and a frequency component matrix is obtained and 
normalized. A sequence sequence that performs embedding is then selected using a key, and an inverse orthogonal 
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transform is performed to obtain the image having an embedded watermark. With this method, there is robustness 
with respect to non-reversible compressing but there are problems of color change, contrast change and a low robust- 
ness with respect to partial cutting. In addition, although this method aims to improve the image quality/robustness by 
normalizing and embedding weakly on flat portions and strongly on complex portions of the image, it does not function 

5 effectively Changing the low-frequency band improves the robustness. 

[0012] When there is watermark detection using Ref.2, processing is performed up to normalization when there is 
embedding, and the watermark is detected from the key and the normalized frequency component matrix. This means 
that when the a block size is the same as the image size, there is robustness with respect to magnification and reduction. 
However, quantitative evaluations have not been performed for the reliability of the detected watermark. In addition, 

10 there is also a problem of a large amount of image deterioration when the watermark is embedded. 

[0013] With the method of Ref.3, processing is implemented to take a transform matrix of an equivalent signal trans- 
form (such a RGB < > YCbCr or the like) for a color image and change it slightly in accordance with watermark for 

something defined. Watermark information detection for Ref.3 involves performing an equivalent signal transform on 
the detected object image and then using statistical values to detect whether or not there is a special status due to the 

15 watermark. With this detection, the method of Ref.3 has a robustness with respect to geometrical changes of the image. 
However, the method is extremely weak with respect to non-reversible compression and color changes. In addition, 
when there is multi-bit embedding, the embedding is for one bit per block and so there is a problem that the robustness 
with respect to geometrical transformation is extremely weak. 

20 SUMMARY OF THE INVENTION 

[0014] Accordingly, it is general object of the present invention to provide a watermark embedding method, a water- 
mark detection method, a watermark embedding apparatus, a watermark detection apparatus, a storage medium stor- 
ing a watermark embedding program, a storage medium storing a watermark detection program, a watermark system, 

25 and an integrated circuit which can perform a high-speed embedding process even when there is detection processing 
without an original image and it is not known which portion of a partial image corresponds to the original image. 
[0015] It is another object of the present invention it to provide a watermark detection method, a watermark embed- 
ding apparatus, a watermark detection apparatus, a storage medium storing a watermark embedding program, a stor- 
age medium storing a watermark detection program, a watermark system, and an integrated circuit, which use a cal- 

30 culation method based on visual characteristics, for the image's degree of local complexity, to enable a relative im- 
provement in the robustness of a watermark. 

[0016] The above objects of the present invention are achieved by a method for embedding a watermark so that it 
cannot be sensed by a person, which method includes a step for. when the watermark is to be embedded in a digital 
image, independently changes real number components and imaginary number components of each of coefficient 
35 values of a complex watermark coefficient matrix using key. from the watermark to be embedded in the digital image: 
a step for performing a discrete Fourier transform on the sequence matrix of the changed watermark and generating 
a watermark pattern; and a step for adding like tiling the water mark pattern to the original image and generating an 
embedded image. 

[0017] According to the present invention, it is possible to independently change the real number components and 

40 the imaginary number components of each coefficient value of the complex watermark coefficient matrix, from the key 
and the watermark, perform a discrete Fourier transform on the changed watermark coefficient matrix to generate a 
watermark pattern, add like tiling a watermark pattern to an original image, and generate an embedded image. 
[0018] In addition, the above objects of the present invention are achieved by a watermark embedding method which 
when embedding a watermark so that cannot be perceived visually in a digital image, comprises a step for determining 

45 a degree of local complexity of an image, and. in accordance with the degree of local complexity of the image, changes 
complex portions of the image more than not so complex portions, and obtains an embedded image. 
[0019] According to the present invention, it is possible to create image degrees of local complexity that have relatively 
large values for textured domains and relatively small values for smooth domains and edge portions. This makes it 
possible to realize more adaptive information management for the visual characteristics than does the conventional art. 

50 [0020] In addition, the above object of the present invention are achieved by a watermark embedding method which, 
when embedding a watermark so that it cannot be perceived by visually in a digital image, comprises a step for gen- 
erating a local degree of complexity of an image from input information that is a digital image; a step for using key 
necessary for embedding to generate a watermark pattern from a watermark, a step for adding the watermark pattern 
to the input image in accordance with the degree of local complexity of the image; and a step for generating an image 

55 in which the watermark is embedded. 

[0021] According to the present invention, it is possible, when embedding, to add a pattern that expresses a design 
of an original image, and so enable a further improvement to the image quality, that is. the relative robustness. 
[0022] In addition, the above objects of the present invention are achieved by a watermark embedding method which. 
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when embedding a watermark so that it cannot be perceived visually in a digital image, comprises a step for dividing 
a digital input image into blocks of a required size and generating a degree of local complexity of an image; a step for," 
using key necessary for embedding to generate a basic watermark pattern which forms the basis for the watermark; 
a step for generating an adaptive watermark pattern that has orthogonal transform sequences corresponding to the 
5 basic watermark pattern emphacized in accordance with a value of an amplitude of an orthogonal transform sequence 
of each block; a step for adding the basic watermark pattern and the adaptive watermark pattern to the blocks in 
accordance with an emphasis parameter and the degree of local complexity of the image; and a step for generating 
an image in which watermark pattern information is embedded. 

[0023] As described above, according to the present invention, when there is a watermark embedding method of 

w the type that divides an image into blocks, changes a sequence matrix obtained by orthogonal transform of those 
blocks and embeds a watermark, the degree of local complexity of each block is used to switch in gradation between 
the two types of watermark patterns comprising, the basic watermark pattern and an adaptive watermark pattern created 
from a sequence matrix obtained from orthogonal transform of the blocks, to obtain in image in which watermark pattern 
information is embedded. Hereby, a component value image obtained by handling edges and textures in the same 

*5 manner, texture degree indexes obtained from the local density of the edge/texture component value images, and a 
texture component value image obtained from these two are generated so that it is possible to create a texture com- 
ponent image that has a relatively large value for textured domains and a relatively small value for smooth domains 
or for texture portions, thus realizing adaptive information embedding for visual characteristics to a greater degree than 
in the conventional art. and increasing the relative robustness of the watermark. 

20 [0024] In addition, the above object of on the present invention are achieved by a watermark detection method for 
detecting a watermark from a digital detected object image in which a visually imperceptible watermark has been 
embedded therein, which method comprises a step for separating a block from an arbitrary position on the detected 
object image; a step for performing a discrete Fourier transform on the block and obtaining a sequence matrix; a step 
for generating position information for a component that is to be detected and that is specified by the key; a step for 

25 detecting a position marker sequence by calculating a phase difference of a sequence by an amount of parallel dis- 
placement, for each item of the position information, and extracting offset information which is the amount of parallel 
displacement when there is agreement between a start point of an embedded watermark and a start point of the block 
cut from the detected object image; and a step for detecting the embedded watermark cut from the detected object 
image. 

30 [0025] According to the present invention, it is possible to cut a block from an arbitrary position of a detected object 
image and then, once a discrete Fourier transform has been performed on the block and a sequence matrix obtained, 
take the correlation between a sequence indicating the start point of a watermark pattern and a sequence for the phase 
difference of sequences according to the amount of parallel displacement of each item of the component value se- 
quence, and so perform a search for an amount of parallel displacement, and, as a result of that search, use the amount 

35 of parallel displacement when the maximum response value is output as the amount of parallel displacement from the 
start point of the watermark pattern to the start point of the block cut from the start point of the watermark pattern as 
the amount of parallel displacement, and then use this amount of parallel displacement to further detect an embedded 
watermark. 

[0026] In addition, the above objects of the present invention are achieved by a watermark detection method for 
JO detecting a watermark from a detected object image that has a watermark embedded therein, which method comprises 
a step for detecting object image phase position information from a key; a step for generating a position marker se- 
quence from the key; and a step for using detected position marker detection information to detect offset information 
that indicates the degree of displacement between the start point of a watermark pattern when embedded, and a start 
point of a pixel block cut from the detected object image; and that uses the offset information to detect a watermark 
45 embedded in the image block. 

[0027] According to the present invention, when there is a search for an amount of parallel displacement, it is not 
necessary to perform a discrete Fourier transform for each scan as only one discrete Fourier transform prior to the 
search is sufficient and so it is possible to shorten the detection processing time to less than is required for a simple 
search forthe amount of parallel displacement (as in the method that performs an orthogonal transform while displacing 
50 coordinates and then scans). 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0028] Other objects, features and advantages of the present invention will become more apparent from the following 
55 detailed description when read in conjunction with the accompanying drawings, in which: 

Fig.1 is a diagram showing the configuration of an watermark embedding apparatus according to the first embod- 
iment of the present invention; 
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Fig. 2 is a flow chart showing the process of the watermark embedding apparatus according to the first embodiment 
of the present invention; 

Fig. 3 is a diagram showing the configuration of an embedding object component specification portion of the first 
embodiment of the present invention; 
5 Fig. 4 is a flow chart showing the process of an embedding object component specification portion of the first 

embodiment of the present invention; 

Fig. 5 is a diagram showing the configuration of an embedding sequence generation portion of the first embodiment 
of the present invention; 

i Fig. 6 is a flow chart showing the process of the embedding sequence generation portion of the first embodiment 

w of the present invention; 

Fig. 7 is a flow chart of the process of a component value change portion of the first embodiment of the present 
invention; 

Fig. 8 is a diagram describing the process of a discrete Fourier transform portion of the first embodiment of the 
present invention; 

15 Fig. 9 is a diagram describing the process of the watermark pattern adding portion of the first embodiment of the 

present invention; 

Fig. 10 is a diagram showing the configuration of a watermark detection apparatus according to the second em- 
bodiment of the present invention; 

Fig. 11 is a flow chart showing the process of the watermark detection apparatus according to the second embod- 
20 iment of the present invention; 

Fig. 12 is a diagram showing the configuration of a detected object component specification portion according to 
the second embodiment of the present invention; 

Fig. 13 is a flow chart showing the process of the detected object component specification portion according to the 
second embodiment of the present invention; 
25 Fig. 14 is a diagram showing the configuration of a position marker sequence generation portion according to the 

second embodiment of the present invention; 

Fig. 15 is a flow chart showing the process of the position marker sequence generation portion according to the 
second embodiment of the present invention; 

Fig. 16 is a diagram showing the configuration of the position marker detection portion according to the second 
20 embodiment of the present invention; 

Fig. 17 is a flow chart showing the process of the position marker detection portion according to the second em- 
bodiment of the present invention; 

Fig. 18 is a diagram describing the process of a block generation portion according to the second embodiment of 
the present invention; 

35 Fig. 19 is a flowchart showing the process of a block generation portion according to the second embodiment of 

the present invention; 

Fig. 20 is a flow chart showing the process of a detected object-image object sequence generation portion according 
to the second embodiment of the present invention; 

Fig. 21 is a diagram showing the configuration of a watermark detection portion according to the second embod- 
40 iment of the present invention; 

Fig. 22 is a flow chart showing the process of the watermark detection portion according to the second embodiment 
of the present invention; 

Fig. 23 is a diagram showing the configuration of symbol detection portion according to the second embodiment 
of the present invention; 

Fig. 24 is a flow chart showing the process of the symbol detection portion according to the second embodiment 
of the present invention; 

Fig. 25 is a diagram showing the configuration of symbol sequence generation portion according to the second 
embodiment of the present invention; 

Fig. 26 is a flow chart showing the process of the symbol sequence generation portion according to the second 
50 embodiment of the present invention; 

Fig. 27 is a diagram showing the configuration of a detection result generation portion according to the second 
embodiment of the present invention; 

Fig. 28 is a flow chart showing the process of the detection result generation portion according to the second 
embodiment of the present invention; 
55 Fig. 29 is a flow chart showing the process of a block generation portion according to a third embodiment of the 

present invention; 

Fig. 30 is a diagram describing the process of th~ block generation portion according to the third embodiment of 
the present invention; 
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Fig. 31 is a diagram describing the process of the block generation portion according to the fourth embodiment of 
the present invention; : 
Fig. 32 is a flow chart showing the process of the block generation portion of a position marker detection portion 
according to a fourth embodiment of the present invention; 
5 Fig. 33 is a diagram showing the configuration of the watermark detection portion according to a fifth embodiment 

of the present invention; 

Fig. 34 is a flow chart showing the process of the watermark detection portion according to the fifth embodiment 
of the present invention; 

Fig. 35 is a diagram describing the process of a block division portion according to a fifth embodiment of the present 
10 invention; 

Fig. 36 is a diagram showing the configuration of a symbol detection portion according to the fifth embodiment of 
the present invention; 

Fig. 37 is a flow chart showing the process of the symbol detection portion according to the fifth embodiment of the 
present invention; 

15 Fig. 38 is a diagram showing the configuration of the symbol sequence generation portion according to the fifth 

embodiment of the present invention; 

Fig. 39 is a flow chart showing the process of the symbol sequence generation portion according to the fifth em- 
bodiment of the present invention; 

Fig. 40 is a diagram showing the configuration of a detection result generation portion according to the fifth em- 
20 bodiment of the present invention; 

Fig. 41 is a flow chart showing the process of the detection result generation portion according to the fifth embod- 
iment of the present invention; 

Fig. 42 is a diagram showing the configuration of a watermark detection portion according to a sixth embodiment 
of the present invention; 

25 Fig, 43 is a flow chart showing the process of the watermark detection portion according to the sixth embodiment 

of the present invention; 

Fig. 44 is a diagram describing the process of a block division portion according to the sixth embodiment of the 
present invention; 

Fig. 45 is a diagram showing the configuration of a symbol detection portion according to the sixth embodiment of 
30 the present invention; 

Fig. 46 is a flow chart showing the process of the symbol detection portion according to the sixth embodiment of 
the present invention; 

Fig. 47 is a diagram showing the configuration of a symbol sequence generation portion according to the sixth 
embodiment of the present invention; 
35 Fig. 48 is a flow chart showing the process of the symbol sequence generation portion according to the sixth em- 

bodiment of the present invention; 

Fig. 49 is a diagram showing the configuration of a detection result generation portion according to the sixth em- 
bodiment of the present invention: 

Fig. 50 is a flow chart showing the process of the detection result generation portion according to the sixth embod- 
JO iment of the present invention; 

Fig. 51 is a diagram showing the configuration of the watermark detection portion according to the seventh em- 
bodiment of the present invention; 

Fig. 52 is a flow chart showing the process of a watermark detection portion according to the seventh embodiment 
of the present invention; 

45 Fig. 53 is a diagram describing the process of a block division portion according to the seventh embodiment of the 

present invention; 

Fig. 54 is a diagram showing the configuration of a symbol detection portion according to the seventh embodiment 
of the present invention; 

Fig. 55 is a flow chat showing the process of the symbol detection portion according to the seventh embodiment 
50 of the present invention; 

Fig. 56 is a diagram showing the configuration of a symbol sequence generation portion according to the seventh 
embodiment of the present invention; 

Fig. 57 is a flow chart showing the process of the symbol sequence generation portion according to the seventh 
embodiment of the present invention; 
55 Fig. 58 is a diagram showing the configuration of a detection results generation portion according to the seventh 

embodiment of the present invention: 

Fig. 59 is a flow chart showing the process of [h~ detection results generation portion according to the seventh 
embodiment of the present invention: 
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Fig. 60 is a diagram showing the configuration of a block generation portion of a position marker detection portion 
according to an eighth embodiment of the present invention; 

Fig. 61 is a flow chart showing the process of the block generation portion of the position marker detection portion 
according to the eighth embodiment of the present invention; 

Fig. 62 is a diagram describing the process of the block generation portion according to the eighth embodiment of 
the present invention; 

Fig. 63 is a diagram showing the configuration of the block generation portion of the position marker detection 
portion according to a ninth embodiment of the present invention; 

Fig. 64 is a flow chart showing the process of the block generation portion of the position marker detection portion 
according to the ninth embodiment of the present invention; 

Fig. 65 is a diagram describing the block division of the block generation portion according to the ninth embodiment 
of the present invention; 

Fig. 66 is a.diagram describing the process of a cyclic shift portion of the block generation portion according to the 
ninth embodiment of the present invention; 

Fig. 67 is a diagram showing the configuration of a block generation portion of a position marker detection portion 
according to a tenth embodiment of the present invention; 

Fig. 68 is a flow chart showing the process of the block generation portion of the tenth embodiment of the present 
invention; 

Fig. 69 is a diagram describing the process of the block generation portion of the tenth embodiment of the present 
invention; 

Fig. 70 is a diagram showing division processing of the block generation portion according to the tenth embodiment 
of the present invention; 

Fig. 71 is a diagram showing the process of a cyclic shift portion according to the tenth embodiment of the present 
invention; 

Fig. 72 is a diagram showing the configuration of a watermark detection apparatus according to a an eleventh 
embodiment of the present invention; 

Fig. 73 is a diagram showing the process of an watermark detection apparatus according to the eleventh embod- 
iment of the present invention; 

Fig. 74 is a diagram showing the configuration of a detected object component specification portion according to 
an eleventh embodiment of the present invention; 

Fig. 75 is a flow chart shoring the process of the detected object component specification portion according to the 
eleventh embodiment of the present invention; 

Fig. 76 is a diagram showing the configuration of a position marker sequence generation portion according to the 
eleventh embodiment of the present invention; 

Fig. 77 is a flow chart showing the process of the position marker sequence generation portion according to the 
eleventh embodiment of the present invention; 

Fig. 78 is a diagram showing the configuration of a position marker detection portion according to the eleventh 
embodiment of the present invention; 

Fig. 79 is a flow chart showing the process of the position marker sequence generation portion according to the 
eleventh embodiment of the present invention; 

Fig. 80 is a flow chart showing the process of the detection object sequence generation of the position marker 
detection portion according to the eleventh embodiment of the present invention; 

Fig. 81 is a diagram showing the configuration of a watermark detection portion according to the eleventh embod- 
iment of the present invention; 

Fig. 82 is a flow chart showing the process of the watermark detection portion according to the eleventh embodiment 
of the present invention; 

Fig. 83 is a diagram showing the configuration of a symbol detection portion according to the eleventh embodiment 
of the present invention; 

Fig. 84 is a flow chart showing the process of the symbol detection portion according to the eleventh embodiment 
of the present invention; 

Fig. 85 is a diagram showing the configuration of the symbol generation portion according to the eleventh embod- 
iment of the preset invention; 

Fig. 86 is a flow chart showing the process of the symbol generation portion according to the eleventh embodiment 
of the present invention; 

Fig. 87 is a diagram showing the configuration of a detection results generation portion according to the eleventh 
embodiment of the present invention; 

Fig. 88 is a flow chart showing the process of (he detection results generation portion according to the eleventh 
embodiment of the present invention: 
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Fig. 89 is a diagram describing the process of the position marker detection portion according to a twelfth embod- 
iment of the present invention; 

Fig. 90 is a diagram showing the configuration of the watermark detection portion according to a thirteenth embod- 
iment of the present invention; 

5 Fig. 91 is a flow chart showing the process of the watermark detection portion according to the thirteenth embod- 

iment of .the present invention; 

Fig. 92 is a diagram describing the process of a block division portion according to the thirteenth embodiment of 
the present invention; 

Fig. 93 is a diagram showing the configuration of a symbol detection portion according to the thirteenth embodiment 
w of the present invention; 

Fig. 94 is a flow chart showing the process of the symbol detection portion of the thirteenth embodiment of the 
present invention; 

Fig. 95 is a diagram showing the configuration of a symbol sequence generation portion according to the thirteenth 
embodiment of the present invention: 
15 Fig. 96 is a flow chart showing the process of the symbol sequence generation portion according to the thirteenth 

embodiment of the present invention; 

Fig. 97 is a diagram showing the configuration of a detection result generation portion according to the thirteenth 
embodiment of the preset invention; 

Fig. 98 is a flow chart showing the process of the detection result generation portion according to the thirteenth 
20 embodiment of the present invention; 

Fig. 99 is a diagram describing the process of a block division portion of a watermark detection portion according 
to a fourteenth embodiment of the present invention; 

Fig. 100 is a diagram showing the configuration of a block generation portion of a position marker detection portion 
according to a fifteenth embodiment of the present invention; 
25 Fig. 101 is a flow chart showing the process of the block generation portion according to the fifteenth embodiment 

of the present invention; 

Fig. 102 is a diagram describing the process of the block generation portion according to the fifteenth embodiment 
of the present invention; 

Fig. 103 is a diagram showing the configuration of a block generation portion of a position marker detection portion 
30 according to a sixteenth embodiment of the present invention; 

Fig. 104 is a flow chart showing the process of the block generation portion of the position marker detection portion 
according to the sixteenth embodiment of the present invention; 

Fig. 105 is a diagram describing the process of the block generation portion according to the sixteenth embodiment 
of the present invention; 

35 Fig. 106 is a flowchart showing the process of an offset information generation portion of a position marker detection 

portion according to a nineteenth embodiment of the present invention; 

Fig. 107 is a flow chart showing the process of a detection results generation portion of a watermark detection 
portion according to a twentieth embodiment of the present invention; 

Fig. 108 is a graph showing the theoretical values and the corr values according to a computer simulation of a 
jo twenty-first embodiment of the present invention; 

Fig. 109 is a graph of symbol detect information according to a computer simulation of the twenty-first embodiment 
of the present invention; 

Fig. 110 is a diagram showing the PSNR when the embedding intensity of the present invention is changed; 
Fig. 11 1 is a diagram showing the results of using computer simulation of the present invention to detect watermark 
45 from an image containing a watermark: 

Fig. 11 2 is a diagram showing the result of using computer simulation of the present invention to detect watermark 
from a partial image; 

Fig. 113 is a diagram showing a failed detection and successful partial image using computer simulation of the 
present invention; 

so Fig. 114 is a diagram showing detection results from a JPEG compressed image using a computer simulation of 

the present invention; 

Fig. 11 5 is a diagram showing a gray scale image (binary image) using a computer simulation of the present in- 
vention; 

Fig. 116 is an example of a composite image using a computer simulation of the present invention: 
55 Fig. 11 7 is a diagram showing a configuration of a watermark embedding apparatus according to a twenty-second 

embodiment of the present invention: 

Fig. 11 8 is a flow chart showing the process of a watermark embedding apparatus according to a twenty-second 
embodiment of the present invention; 
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Fig. 1 1 9 is a flow chart showing the process of an edge/textue component value image creation portion according 
to the twenty-second embodiment of the present invention; 

Fig. 120 is an example of an input image and an edge/texture component image according to the twenty-second 
embodiment of the present invention; 

Fig. 121 is a diagram showing the'configuration of a watermark embedding apparatus according to a twenty-third 
embodiment of the present invention; 

Fig. 122 is a flow chart showing the process of the watermark embedding apparatus according to a twenty-third 
embodiment of the present invention; 

Fig. 1 23 is a flow chart showing the process of a texture degree index creation portion according to the twenty-third 
embodiment of the present invention; 

Fig. 124 is a diagram describing the process of an up-sampler according to the twenty-third embodiment of the 
. present invention; 

Fig. 1 25 is a diagram showing an edge/texture component value image and texture degree according to the twenty- 
third embodiment of the present invention: 

Fig. 126 is a flow chart showing the process of a watermark embedding apparatus according to a twenty-fourth 
embodiment of the present invention; 

Fig. 127 is a flow chart showing the process of a texture degree index creation portion according to the twenty- 
fourth embodiment of the present invention; 

Fig. 128 is a diagram showing the configuration of a watermark embedding apparatus according to a twenty-fifth 
embodiment of the present invention; 

Fig. 129 is a flow chart showing the process of the watermark embedding apparatus according to the twenty-fifth 
embodiment of the present invention; 

Fig. 130 is a flow chart showing the process of a texture component value image creation portion according to the 
twenty-fifth embodiment of the present invention; 

Fig. 1 31 is a diagram showing image input and output by each portion of the twenty-fifth embodiment of the present 
invention; 

Fig. 132 is a diagram showing the configuration of a watermark embedding apparatus according to a twenty-sixth 
embodiment of the present invention; 

Fig. 133 is a flow chart showing the process of the watermark embedding apparatus according to the twenty-sixth 
embodiment of the present invention; 

Fig. 134 is a diagram showing the configuration of a watermark embedding apparatus according to a twenty-seventh 
embodiment of the present invention; 

Fig. 135 is a flow chart showing the process of the watermark embedding apparatus according to the twenty-seventh 
embodiment of the present invention; 

Fig. 136 is a flow chart showing the process of an adaptive watermark pattern creation portion according to the 
twenty-seventh embodiment of the present invention; 

Fig. 137 is a diagram showing a block and pattern in the processing of embedding a watermark according to the 
twenty-seventh embodiment of the present invention. 

Fig. 138 is a diagram showing the configuration of a integrated circuit according to a twenty-eight embodiment of 
the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0029] A detailed description of embodiment of the present invention will now be given with reference to the figures. 
[First Embodiment] 

[0030] This embodiment describes a first embodiment of watermark embedding. 

[0031] Fig.1 is a diagram showing the configuration of the watermark embedding apparatus according to a first em- 
bodiment of the present invention. 

[0032] The watermark embedding apparatus 100 is configured by a watermark pattern adding portion 110. and em- 
bedding sequence generation portion 120, an embedding object component specification portion 130. a component 
value change portion 140. and a discrete Fourier transform portion 150. 

[0033] The watermark embedding apparatus 100 inputs an input image 101 . an intensity parameter 102. a watermark 
103, and a key 104, and ultimately outputs an embedded image 105. 

[0034] The following is an outline of the operation according to the above configuration. 

[0035] Fig. 2 is a flow chart showing the process of the watermark embedding apparatus according to the first em- 
bodiment of the present invention. 
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[0036] Step 110) The watermark embedding apparatus 100 that has received the above-mentioned inputs, first of 
all, in the embedding object component specification portion 130. uses the key 104 to generate embedding object- 
component position information 131 which is sent to the component value change portion 140. 

[0037] Step 120) In addition, in the embedding sequence generation portion 120, the key is used to disperse position 
5 marker information of the watermark to from an the embedding sequence 121 , which is sent send it to the component 
value change portion 140. 

[0038] Step 1 30) The component value change portion 140 uses the embedding sequence 121 and the embedding 
object component position information 131 from the embedding object component specification portion 130 to make 
an initial value of a watermark coefficient matrix 141 the zero matrix. 
w [0039] Step 140) The component value change portion 140 changes the component value of the watermark coeffi- 
cient matrix 141. 

[0040] Step 1 50) The discrete Fourier transform portion 150 performs a discrete Fourier transform on the watermark 
coefficient matrix and creates the watermark pattern 151 . 

[0041] Step 1 60) The watermark patte rn adding portion 110 uses the intensity parameter to emphasize the watermark 
/5 pattern 151 , and add like tiling the watermark pattern to the input image 101 , and outputs an embedded image 105. 
[0042] The following description explains a description of the processing in the embedding object component spec- 
ification portion 1 30. Fig. 3 is a diagram showing the configuration of embedding object component specification portion 
of the first embodiment of the present invention. 

[0043] In this figure, the embedding object component specification portion 130 has a random number generator 
20 132 that inputs the key 104 and generates the embedding object component position information 131. 

[0044] Fig. 4 is a flow chart showing the process of the embedding object component specification portion according 
to the first embodiment of the present invention. 

[0045] Step 111) The embedding object component specification portion 130 inputs key 104 and uses the random 
number generator 132 to generate a random number sequence that takes the key 104 as its initial value. 
25 [0046] Step 112) The embedding object component specification portion 130 also uses the generated random 
number sequence as the basis for generating embedding object component position information 131 which is a se- 
quence having a length the same as the length n of the embedding sequence which will be described later. 
[0047] The embedding object component position information 131 is configured as described below. 

30 L k = (x k .y k .z k )(0§k<n) 

x k : embedding object component sequence x-direction second degree; 
y k : embedding object component sequence y-direction second degree; 
35 z k : flag expressing real or imaginary for the embedding object sequence (whether or not it is a real number com- 

ponent or an imaginary number component) 

[0048] In each item of the embedding object component position information 131 . the embedding object component 
specification portion 130 avoids duplication (all of the three components above must not be in agreement for the two 
40 items L k and L m , In addition . in order to compensate for the addition of digital noise and irreversible decompression. 

7 X k 2 + y k 2 < r 

45 so that there is a bandwidth limit preventing sequences from being selected from the high-frequency region. Further- 
more, although signals obtained from the discrete Fourier transform become real numbers, embedding which maintains 
a necessary symmetry of the sequence matrix. 

5q F(u.v) = F* (N-u, N-v) 

(where F(u.v) is a Fourier transform of the sample value f(x.y)(0 ;? x< N. 0 « y< N) where N is the size of the length 
and width of the sequence matrix to be described later, and * indicates a complex conjugate), requires that only positive 
values be selected for the x-direction second degree or the y-direction second degree of the embedding symmetry 
55 sequence. The embedding object component position information 1 31 is sent to the component value change portion 
140. 

[0049] The following is a description of the configuration of the embedding sequence generation portion 120 in the 
present embodiment. 
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[0050] Fig. 5 is a diagram configuration of the embedding sequence generation portion of the first embodiment of the 
present invention. The embedding sequence generation portion 120 has a spread sequence generator 122 that inputs 
the watermark 103 and the key 104. Basically, the direct spread method in spread spectrum communications is used 
as the basis. Specifically, the spread sequence generator 122 shown in Fig. 5, generates the embedding sequence 
5 121 which is a real number sequence of length n. 

[0051] Fig. 6 is a flow chart showing the process of the embedding sequence generation portion of the first embod- 
iment of the present invention. 

[0052] Step 121) Position marker spread: The spread sequence generator 122 takes a sequence of length n, and 
expresses each of spread sequences as r M when it is to generate K types (where 0^ k< K-1). The spread sequence 
10 uses, for example, an M-sequence, etc.). 

[0053] In particular the spread sequence generator 122 takes the key 104 as an initial value and generates a spread 
sequence { Tj < 0) } (0^ i < n), multiplies it by a weighting value value a (a 1 ) that is determined beforehand, and stores 
the result in the real number buffer { m s } (0^ 1 < n) 
[0054] . Expressing this as an equation gives the following: 

15 

m. = a. • r. {0) (0^ i < n) 

(:= indicates that the value of the right side of the equation can be substituted into the left) 
20 [0055] Step 122) Conversion into a watermark symbol expression: 

[0056] The embedding sequence generator 120 converts the watermark 103 into a symbol expression. For example. 

if the watermark is 4-character 8-bits per character information and there is conversion into a symbol for each eight 

bits, it is possible to convert the watermark into the watermark four symbols (with the value of each symbol being from 

0 - 255. which is equivalent to ASCII text code). When this occurs, the number of symbols is smaller than K. and the 
25 maximum value a symbol can have is selected so that it is smaller than n. The value of each symbol is Sj (1 j ^ J 

(< K)). with the maximum value of Sj being expressed as M (?? n). 

[0057] Step 123) Dispersion of the watermark: 

[0058] The embedding sequence generator 120 adds a spread sequence corresponding to each symbol s^ to {m J , 
for each terms of j'th item. In particular, the symbol value Sj is added to the key 104. the sum is used as the initial 
30 value, and the spread sequence {r ( <°> } (0 ? i < n) having the length n for the j'th item is generated by the spread 
sequence generator 122. 

[0059] After this, the embedding sequence generator 120 adds each item of {r ; 0) } to each item {m j } . Expressing 
this as an equation gives the following. 

35 () 

m i :m i + r i (°-' 

where this is repeated for the interval 1 5 j * : - J. 

[0060] Step 124) The embedding sequence generator 120 subtract the average value from each item of 
-to { mj } so that the average value of { rrij } obtained for up to Step 123 above is 0. and outputs that result as the embedding 
sequence 121 which is sent to the component value change portion 140. 
Expressing the subtraction processing as a formula gives the following. 



45 



ave : 



m , 



^ rrr = m ( - ave {OrS i n) 

[0061] The following is a description of the process of the component value change portion 140 of the present em- 
bodiment. 

[0062] The component value change portion 140 inputs the embedding object component position information 131 
55 and the embedding sequence 121 and generates the watermark coefficient matrix by the procedure shown in Fig. 7. 
[0063] Fig. 7 is a flow chart of the process of the component value change portion of the first embodiment of the 
present invention. 

[0064] Step 131) In the component value change portion 140. a watermark coefficient matrix F(u.v) is prepared as 
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a complex matrix of size NxN and the initial value is made the zero matrix. 

[0065] Step 141) The component value change portion 140 uses L k = (x k ,y k ,z k ) which is the embedding object- 
component position information 131 for the k'th item and changes the elements F(u,v). 

[0066] Step 142) When z k is a value expressing a real number component: The component value change portion 
5 140 adds the real number component F(x k ,Y k ) to m k . In addition, so that the Fourier transform sequence holds its 
symmetry, the real number component of F(N- x k ,N - y k ) is also added to m k . Expressing this as an equation gives 
the following: 

10 F ( x k -yk) :=F ( x k -yk) + m k 

F(N - x k , N - y k ) : F(N - x k .N - y k ) +m k 

is [0067] Step 143) When z k is a value expressing an imaginary number: The component value change portion 140 
adds the imaginary number component F(x k .y k ) to m k . In addition, so that the Fourier transform sequence holds its 
symmetry the real number component of F(N - x k , . N - y k ) is subtracted from m k . Expressing this as an equation 
gives the following: 

20 

F( x k .y k ):= F(x k ,y k ) + m k • i 
F(N - x k . N - y k ):= F(N - x k .N - y k )+m k • i 

25 

(where i is an imaginary number unit). The above mentioned the equation performs in order to k=0 ■•■ n-1. 
[0068] The following is a description of the process of the discrete Fourier transform portion 150 of the first embod- 
iment of the present invention. 

[0069] Fig. 8 is a diagram describing the process of the discrete Fourier transform portion of the first embodiment of 
30 the present invention. 

[0070] The discrete Fourier transform portion 150 obtains the watermark pattern 151 that is the real number matrix 
(that has had the imaginary number component discarded) of size NxN obtained by performing a discrete Fourier 
transform on the watermark coefficient matrix 141, and sends the watermark pattern 151 to the watermark pattern 
adding portion 110. 

35 [0071] The following is a description of the process of the watermark pattern adding portion 110 of the first embod- 
iment of the present invention. 

[0072] Fig. 9 is a diagram describing the process of the watermark pattern adding portion of the first embodiment of 
the present invention. 

[0073] The watermark pattern adding portion 110 emphasizes the watermark pattern 151 by the value of the intensity 
40 parameter, and adds like tiling the watermark pattern 151 to the input image 101, and generates and outputs an em- 
bedded image. 

Expressing this as an equation gives the following. 
{I xy } : input image (0 5 x < Width, 0^y < Height) 

(Width is the horizontal size of the input image. Height is the vertical size of the input image.) 
45 [0074] When 

(W y} : watermark pattern (0 ^i. j< N) 
power: intensity parameter, 
it is determined by 

'V= 'xy + Powers • W X%N y%N 

(0^ x < Width. 0$ y < Height) (a%b) expresses the remainder when a is divided by b.) The watermark pattern adding 
portion 110 outputs {l' xy } as the embedded image 105. 
55 Moreover, when the value of the intensity parameter is 1 . the watermark pattern is added without any emphasis. That 
is. this is the same as the case when an intensity parameter is not used. 

[0075] This ends the process of the watermark embedding apparatus 100 according to the present embodiment. 
[0076] In the processing for the embedding of a watermark by the present embodiment, an N x N sized 2-dimensional 
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discrete Fourier transform is used once only; With the conventional technology, it is necessary to divide an image into 
blocks of Nx N size discrete Fourier transform operations and inverse discrete Fourier transform operations for each 
block. For example if there is b number of blocks, the ratio of the amount of embedding processing according to the 
first embodiment and the conventional technology becomes 1 :2b, meaning that it is possible to have high-speed em- 
5 bedding processing if the first embodiment is used. 

[Second Embodiment] 

[0077] The following is a description of the processing for detecting a watermark embedded by the watermark em- 
10 bedding apparatus of the first embodiment. 

[0078] Fig. 10 is a diagram showing the configuration of a watermark detection apparatus according to a second 
embodiment of the present invention. 

[0079] A watermark detection apparatus 200 is an apparatus for detecting an embedded watermark from an image 
resulting from processing (partial discard, irreversible compression, etc.) being performed on an embedded image 
75 obtained using the method of the first embodiment described above. 

[0080] The watermark detection apparatus 200 comprises a detected object component specification portion 210. a 
position marker sequence generation portion 220. a position marker detection portion 230, and a watermark detection 
portion 240. 

[0081] Fig. 11 is a flow chart showing the process of a watermark detection apparatus according to a second embod- 

20 iment of the present invention. 

[0082] Step 210) The watermark detection apparatus 200 inputs a key 202 which is the same as that was used for 
embedding. First, in the detect object component specification portion 210. a method the sarnie as that of the embedding 
object component specification portion 130 of the first embodiment described above, is used to generate detected 
object component position information 211 from the key, which is sent the position marker detection portion 230 and 

25 the watermark detection portion 240. 

[0083] Step 220) In the position marker sequence generation portion 220, a position marker sequence 221 is gen- 
erated from the key 202 and sent to the position marker detection portion 230. 

[0084] Step 230) The position marker detection portion 230 cuts an N x N (N is same as the watermark pattern size 
in the first embodiment) size block from a detected object image 201 . and, when the start point of the cut pixel block 
^0 is in agreement with the start point of the embedded watermark pattern, the start point of the pixel block is output as 
offset information 231 and sent to the watermark detection portion 240. 

[0085] Step 240) The watermark detection portion 240 cuts a pixel block of size N x N from the offset position 
specified by using the detected object image 201. key 202. detected object component position information 211 and 
offset information 231. detects the watermark embedded in that pixel block and outputs a detection result 203. 
35 [0086] The following is a description of the detected object component specification portion 210 in the present em- 
bodiment. 

[0087] Fig. 12 is a diagram showing the configuration of the detected object image object component specification 
portion according to the second embodiment of the present invention and Fig. 13 is a flow chart showing the process 
of the detected object component specification portion according to the second embodiment of the present invention. 
-to [0088] Step 211) The detected object component specification portion 210 has a random number generator 212, 
inputs the key 202 and uses the random number generator 212 to generate a random number sequence using said 
key 202 as an initial value. 

[0089] Step 212) The random number sequence is used as the basis for generating the detected object component 
position information 211 which is a sequence having the same length as the length n of the embedding sequence used 
4 5 jn the previously described first embodiment. 

[0090] The detected object component position information 211 has the following configuration. 

L k =(x k .y K .2 k )(0sk<n) 

50 

x k : embedding object component sequence x-direction second degree; 
y k : embedding object component sequence y-direction second degree; 

z k : flag expressing real or imaginary for the embedding object coefficient (whether or not it is a real number 
component or an imaginary number component) 

55 

[0091] The detected object component specification portion 210 has exactly the same process as the embedding 
object component specification portion 130 of the previously described first embodiment. That is to say, the same key 
is used as the input, and the embedding object component position information 1 31 generated by the embedding object 
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component specification portion 130 of the first embodiment and the detected object component position information 
211 generated by the detected object component specification portion 210 of the present embodiment are exactly ther 
same. The generated detected object component position information 211 is sent to the position marker detection 
portion 230. 

5 [0092] The following is description of the position marker sequence generation portion 220 in the present embodi- 
ment. 

[0093] Fig. 14 is a diagram showing the configuration of the position marker sequence generation portion according 
to the second embodiment of the present invention, and Fig. 15 is a flow chart showing the process of the position 
marker sequence generation portion according to the second embodiment of the present invention. 

10 [0094] Step 221 ) The position marker sequence generation portion 220 has a spread sequence generator 222, inputs 
the key 202. and uses the spread sequence generator 222 to generate a spread sequence {r,- (°) } of length n for the 
0'th item the spread sequence having the key 202 as the initial value and being used as it is as the position marker 
sequence 221{ {p } } (0^ i < n)(p { :=r - { <°> (0?r i < n))), which is then sent to the position marker detection portion 230. 
The spread sequence generator 222 in the position marker sequence generation portion 220 has the same process 

15 as the spread sequence generator 122 in the embedding sequence generation portion 120 of the previously described 
first embodiment. 

[0095] The following is a description of the process of the position marker detection portion 230 of the present em- 
bodiment. 

[0096] Fig. 16 is a diagram showing the configuration of the position marker detection portion according to the second 
20 embodiment of the present invention. 

[0097] The position marker detection portion 230 shown in this figures comprises an offset candidate information 
generation portion 232. a block generation portion 233. a discrete Fourier transform portion 234. a detected object 
coefficient generation portion 235. a position marker detection information generation portion 236 and an offset infor- 
mation generation portion 237. 

25 [0098] Fig. 17 is flow chart showing the process of the position marker detection portion according to the second 
embodiment of the present invention. 

[0099] Step 231 ) The position marker detection portion 230 inputs the detected object image 201 . the detected object 
component position information 211 and, the position marker sequence 221 and first of all. in the offset candidate 
information generation portion 232. generates offset candidate information 204 (a, b) from (0.0) to (N-1, N-1). 

30 [0100] Step 232) After this, processing in the block generation portion 233 to the position marker detection information 
generation portion 236 is performed for each of the offset candidate information. Fig. 18 is a diagram describing the 
process of the block generation portion according to the second embodiment of the present invention and Fig. 19 is 
flow chart showing the process of the block generation portion according to the second embodiment of the present 
invention. The following is a description of the process of the block generation portion 233 with reference to Fig.1 8 and 

•-35 Fig. 19. 

[0101] Step 232-1) The block generation portion 233 inputs the detected object image 201 and the offset candidate 
information 204. 

[0102] Step 232-2) A pixel block of size N is cut from a position offset by the offset candidate information 204 
(a. b). from the top left of the detected object image 201 . 
40 [0103] Step 232-3) The cut pixel block is sent to the discrete Fourier transform portion 234. 

[0104] Step 233) The discrete Fourier transform portion 234 takes the pixel block, performs a discrete Fourier trans- 
form on the pixel block to generate a detected object coefficient matrix 206. and then sends the detected object coef- 
ficient matrix 206 to the detected object coefficient generation portion 235. 

[0105] Step 234) In the detected object coefficient generation portion 235. the detected object component position 
45 information 211 and the detected object coefficient matrix 206 undergo the following processing to produce a detected 
object coefficient. Fig. 20 is a flow chart showing the process of the detected object coefficient generation portion ac- 
cording to the second embodiment of the present invention. 

[0106] Step 234-1 ) If the detected object component position information 211 is expressed as L k =( x k , y k ,z k )(0 ^ 
k < n). the detected object coefficient matrix 206 is expressed as F(u. v)(0 ^ u < N, 0^ v < N) and a detected object 
so coefficient 207 is expressed as { q k } (0^ k< n). then the detected object coefficient generation portion 235 performs 
the following process. 

[0107] Step 234-2) When z x expresses a real number component, q k =(real number component of F(x.y)). 
[0108] Step 234-3) When z x expresses an imaginary number component, q k ^(imaginary number component of F 
(x.y)). 

55 The above processing in Steps 234-1 . 234-2 is performed sequentially for k = 0 ••- n-1 . 

[0109] Step 234-4) The detected object coefficient 207 {q k } determined by the above processing is output. 
[0110] Step 235) Next, in the position marker detection information generation portion 236. the following equation is 
used to determine a correlation value between the position marker sequence 221 and the detected object sequence 
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207. pair the correlation value with the offset candidate information 204 and output the result as (he position marker 
detection information 208 corr ab . This position marker detection information 208 is determined in accordance with the 
following equation. 

£f ( p , • q , ) 
cor r , b : = - — :z^rrz=r 

J p ■ 3 j q ■ 3 

[0111] The processing in Ohe above block generation portion 233 to the position marker detection information gen- 
eration portion 236 is repeated for all of the offset candidate information (a, b) from (0, 0) to (N-1 . N-1 ). 
[0112] Step 236) Of all of the input position marker detection information 208, the offset information generation portion 
237 outputs that offset candidate information (a, b) that has the greatest correlation value for the all of the input position 
marker sequences 221 and detected object sequence 207. and sends the output offset candidate information as offset 
information 231 to the watermark detection portion 240. 

[0113] The offset information 231 output from the position marker detection portion 230 indicates a degree to which 
the start point of the watermark pattern was offset from the top left of the detected object image 201 when it was 
embedded. 

[0114] The following is a description of the watermark detection portion 240 for the present embodiment. 
[0115] Fig. 21 is a diagram showing the configuration of the watermark detection portion according to the second 
embodiment of the present invention. As shown in the figure, the watermark detection portion 240 is configured from 
a block generation portion 241 . a discrete Fourier transform portion 242, a detected object sequence generation portion 
243, a symbol detection portion 244. and a detection result generation portion 245. 

[0116] Fig. 22 is flow chart showing the process of the watermark detection portion according to the second embod- 
iment of the present invention. 

[0117] Step 241) The watermark detection portion 240 inputs the detected object image 201, detected object com- 
ponent position information 211 . the offset information 231 and the key 202. First of all, the block generation portion 
241, cuts off a pixel block of size Nx N pixels from a position offset by the amount of the offset information (a, b) from 
the top left of the detected object image 201 . 

[0118] Step 242) The discrete Fourier transform portion 242 applies a discrete Fourier transform to the pixel block, 
generates the detected object coefficient matrix 247 and sends the detected object coefficient matrix 247 to the detected 
object sequence generation portion 243. 

[0119] Step 243) The detected object sequence generation portion 243 uses the same processing as the detected 
object sequence generation portion 235 of the position marker detection portion 230 to obtain a detected object se- 
quence 248 and send it to the symbol detection portion 244. 

[0120] Step 244) The symbol detection portion 244 determines a correlation value between the key 202. and the 
detected object sequence 248 and generates symbol detection information 249. 

[0121] Step 245) After all of the symbol detection information 249 has been obtained, the detection result generation 
portion 245 takes a symbol candidate value that has the largest correlation value for each of the symbol positions in 
the symbol detection information 249, as a detected symbol. 

[0122] Step 246) After detect symbols have been determined for all of the symbol positions, the detection result 
generation portion 245 outputs a result of performs an inverse transform on the detected symbols, which result has a 
watermark format, as the detection result 203. 

[0123] The following is a description of the symbol detection portion 244 in the watermark detection portion 240 
described above. Fig. 23 is a diagram showing the configuration of the symbol detection portion according to the second 
embodiment of the present invention. 

[0124] The symbol detection portion 244 shown in the figure is configured from a symbol candidate generation portion 
2441 . a symbol sequence generation portion 2442 and a symbol detection information generation portion 2443, inputs 
the key 202 and the detected object sequence 248. and generates the symbol detection information 249 for each of 
M symbol candidates, for each of J predetermined symbol positions for detection. The following description will be for 
symbol detection for the j'th item (1 j <J). 

[0125] Fig, 24 is a flow chart showing the process of the symbol detection portion according to the second embodiment 
of the present invention. 

[0126] Step 244-1 ) The symbol candidate generation portion 244 1 of the symbol detection portion 244 successively 
generates a symbol candidate c for 0 to M-1 . and performs the processing from Step 2442-2 to 244-3 for each symbol 
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candidate. M expresses the maximum value for the symbol value by symbol conversion in the previously described 
embodiment. 

[0127] Step 244-2) The following is a description of the processing performed by the symbol sequence generation 
portion 2442. Fig. 25 is a diagram showing the configuration of the symbol sequence generation portion according to 
5 the second embodiment of the present invention, and Fig.26 is flow chart showing the process of the symbol sequence 
generation portion according to the second embodiment of the present invention. 

[0128] Step 244-2-1) The symbol sequence generation portion 2442 inputs the key 202 and the symbol candidate 

2444 to a spread sequence generator 2447, and the value that is the sum of c and the key 202 is taken as the initial 
value to generate a spread sequence {r i <°> } (0^ i < n) which is used, as it is, as the symbol sequence 2445 {p j <° ) } 

io (0^i <n) (p j <°> :=r j <°> (0^ i <n) . 

[0129] Step 244-3) The symbol detection information generation portion 2443 uses the detected object sequence 
248. the symbol sequence 2445. the symbol candidate 2445 and the symbol position j that is currently being processed, 
as its input, and uses the following equation to determine the value of a correlation between the symbol sequence 

2445 and the detected object sequence 248. and combines the correlation value, the symbol candidate 2445 and the 
15 symbol position to generate the symbol detection information corr c <i> 249. 



( p , (i) • q . ) 

20 

corr c(j) : = ^ f 

25 [0130] The symbol detection information 249 is sent to the detection result generation portion 245. 

[0131] Fig. 27 is a diagram showing the configuration of the detection result generation portion according to the 
second embodiment of the present invention. The detection result generation portion 245 shown in the figure is con- 
figured from a sequence generation portion 2451 for each of the symbol positions, a detected symbol generation portion 
2452 and an inverse symbol transform portion 2453. 

30 [0132] Fig. 28 is a flow chart showing the process of the detection result generation portion according to the second 
embodiment of the present invention. 

[0133] Step 245-1) First of all. the detection result generation portion 245 inputs the symbol detection information 
249 to the sequence generation portion 2451 for each of the symbol positions, divides the symbol detection information 
249 for each symbol position j and generates the sequence corr c ii> (0^ c < M) for each symbol position and having 
35 the length M. for each j from j=1-J, and sends each symbol position sequence 2454 to the detect symbol generation 
portion 2452. 

[0134] Step 245-2) The detected symbol generation portion 2452 inputs each of the sequences 2454 for each symbol 
position and generates a detected symbol Sj (1-= j < J) 2455 when it finds a symbol candidate c which produces a 
maximum value for the correlation of the sequences 2454 for each symbol position j. 

-io [0135] Step 245-3) When each detected symbol Sj has been determined, the inverse symbol transform portion 2453 
transforms the detected symbol s j from a symbol expression to the original watermark expression (for example, where 
the inverse transform corresponds to the transform in the first embodiment, the inverse symbol transform portion 2453 
performs processing to treat each of the values of the four detected symbols (with the value for each of the detected 
symbols being from 0-255) as ASCII codes and converts the code, into four eight-bit characters) and generates and 

^5 outputs the detection result 203. This detection result 203 indicates a watermark embedded in the detected object 
image 201 . 

[0136] This above processing ends the processing for the watermark detection apparatus according to the second 
embodiment. 

[0137] With the watermark detection according to the second embodiment as described above, a block of pixels is 
50 cut from the detected object image at the same time as the pixel block is displaced, a detected object sequence is 
obtained by performing a discrete Fourier transform, and. by finding the peak of the correlation between the detected 
object sequence and the position marker sequence, the degree to which the start point of the watermark pattern was 
offset from the top left of the detected object image when it was embedded can be determined. By doing this, in cases 
when the detected object image is a partial image (having a size of 2Nx 2N or more) cut from an arbitrary position of 
55 an image that has been embedded with a watermark pattern by the first embodiment, it is possible to correctly determine 
the position of the watermark pattern. Once the amount of offset has been determined, detecting the watermark pattern 
from the pixel block starting from that position enables the embedded watermark to be correctly detected. 
[0138] In addition, with the watermark detection pivr.essing according to the second embodiment, it is not necessary 
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to have an original image (the input image of the first embodiment). Thus, as has been described above, watermark 
detection according to the second embodiment enables without an original image, a watermark to be detected from 
an image cut from an arbitrary position of an image that has been embedded with a watermark pattern. This has not 
been possible with conventional technologies. 

[Third Embodiment] 

[0139] The following is a description of use of the offset information for cyclic shift of a cut pixel block according to 
a third embodiment of the present invention. 

[0140] The following description for the third embodiment is for only those portions that are not the same as the 
second embodiment. 

[0141] The process of the block generation portion 233 in the position marker detection portion 230 of the present 
embodiment will be described first. 

[0142] Fig. 29 is a flow chart showing the process of the block generation portion according to the third embodiment 
of the present invention. 

[0143] Step 301) The block generation portion 233 of the position marker detection portion 230 inputs the offset 
candidate information 204 and the detected object image 201. 

[0144] Step 302) First of all. the block generation portion 233 cuts a block of an Nx N size from the top left of the 
detected object image 201 as shown in Fig. 30. 

[0145] Step 303) Then, the block generation portion 233 performs cyclic shift for this block using the offset candidate 
information 204 as the basis (with portions of the block that protrude due to the parallel displacement being shifted to 
the other side of the block) and obtains the pixel block 205. 
[0146] Expressing this pixel block as a formula gives 

{B y} : for a block of an N x N size cut from the top left of the detected object image 201 . When the pixel block obtained 
by cyclic shift according to the offset candidate information (a. b) is expressed as B' jj = B {i+a)0/iN <j +b)%N where (0< i 
< n). (0?i j < N), and x%y expresses the remainder when x is divided by y. 
then {B'jj} is output as the pixel block 205. 

[0147] The following is a description of the process of the block generation portion 241 in the watermark detection 
portion 240 of the third embodiment of the present invention. 

[0148] The block generation portion 241 in the watermark detection portion 240 of the present invention inputs the 
detected object image 201 and the offset information 231 and uses cyclic shift to generate the a pixel block 246 in the 
same manner as the block generation portion 233 in the position marker detection portion 230 (by the input of offset 
information as offset candidate information), and outputs the pixel block 246. 

[0149] When the present embodiment is used for watermark detection, the necessary size of the detected object 
image 201 is N x N instead of the minimum 2N x 2N of the second embodiment, and so it is possible to perform 
detection from a smaller detected object image. 

[Fourth Embodiment] 

[01 50] The following is a description of a fourth embodiment of the present invention in which the watermark detection 
depends on whether a pixel block is cut from a detected object image having a size of N x N or more, or less than N x N. 
[0151] The description will commence with the block generation portion 233 of the position marker detection portion 
230. Portions other than those described below are the same as for the second embodiment and the third embodiment 
described above. 

[0152] Fig. 31 is a diagram describing the process of the block generation portion according to the fourth embodiment 
of the present invention and Fig. 32 is flow chart showing the process of a block generation portion according to the 
fourth embodiment of the present invention. 

[0153] Step 401) The block generation portion 233 of the position marker detection portion 230 in the present em- 
bodiment inputs the detected object image 201 and the offset candidate information 204. 

[0154] Step 402) The block generation portion 233 judges whether the detected object image 201 is N x N size or 
more, and shifts the processing to Step 403 if it is. and to Step 404 if it is not. 

[01 55] Step 403) The block generation portion 233 cuts a block of size N x N from the top left of the detected object 
image. 

[0156] Step 404) When the detected object image 201 is small and it is not possible to cut a block of N ^ N size, 
the block generation portion 233 cuts only a portion corresponding to the detected object image (Fig.31A). and the 
empty portion of the block is filled with an average value of the pixel values of the portion corresponding to the detected 
object image and processed as that. 

[0157] Step 405) The block generation portion 233 uses the block obtained by the processing described above. 
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performs cyclic shift in the same manner as described above for the third embodiment and obtains a pixel block. 
[0158] Step 406) The block generation portion 233 outputs the obtained pixel block 205. 

[0159] The following is a description of the process of the block generation portion 241 of the watermark detection 
portion 240. 

5 [0160] The block generation portion 241 of the watermark detection portion 240 of the previously described third 
embodiment. inputs the detected object image 201 and the offset information 231, and uses processing the same as 
that for the block generation portion 233 of the position marker detection portion 230 (inputting offset information as 
offset candidate information) to obtain and output the pixel block 246. 

[0161] When there is watermark detection using the present embodiment, the necessary size of the detected object 
io image is an arbitrary size of N x N or more and so it is possible to perform detection on a small object when compared 
to the third embodiment. 

[Fifth Embodiment] 

75 [0162] The following is a description of a fifth embodiment of the present invention. Those portions not described 
below are the same as those of the previously described second embodiment. 
[0163] This embodiment will describe the watermark detection portion. 

[0164] Fig. 33 is a diagram showing the configuration of the watermark detection portion according to the fourth 
embodiment of the present invention. 
20 [0165] The watermark detection portion 500 shown in the figure includes a block division portion 510, a discrete 
Fourier transform portion 520. a detected object sequence generation portion 530, a symbol detection portion 540. 
and a detection result generation portion 550. 

[0166] Fig. 34 is flow chart showing the process of the watermark detection portion according to the fifth embodiment 
of the present invention. 

25 [0167] Step 510) The watermark detection portion 500 inputs the detected object image 201, the detected object 
component position information 211 , the offset information 231 and the key 202 and, first of all, in the block division 
portion 510, divides the detected object image 201 into T pixel blocks of Nx N size, from a position offset from the top 
left of the detected object image 201 by the amount of the offset (a. b), and then gives numbers from 0-T-1 to each of 
the pixel blocks obtained by division as shown in Fig. 35. 

30 [0168] The following processing is performed for the t'th (0 5i t <T) pixel block. 

[0169] Step 520) The discrete Fourier transform portion 520 performs a discrete Fourier transform on the t'th pixel 
block to obtain the detected object coefficient matrix 521. 

[0170] Step 530) The detected object sequence generation portion 530 generates a detected object sequence using 
the detected object component position information^ 11 and the detected object coefficient matrix 521 . 
35 [0171] Step 540) The symbol detection portion 540 determines the correlation value between the detected object 
sequence 531 and a sequence generated from the key 202 and sends symbol detection information to the detection 
result generation portion 550. 

[0172] Step 550) After the symbol detection information 541 has been determined for each t, the detection result 
generation portion 550 performs symbol detection for those symbol candidate values having the largest correlation 
40 value, for each symbol position of the symbol detection information 541 . 

[0173] Step 560) The detection result generation portion 550 then determines the detected symbols from all of the 
symbol positions, inversely transforms the detect symbols into the watermark format and outputs this as the detection 
result 203. 

[0174] The following is a description of the symbol detection portion 540 in the present embodiment. 

45 [0175] Fig. 36 is a diagram showing the configuration of the symbol detection portion according to the fifth embodiment 
of the present invention. The symbol detection portion 540 comprises a symbol candidate generation portion 541. a 
symbol sequence generation portion 542 and a symbol detection information generation portion 543 shown in the 
figure. The symbol detection portion 540 inputs the key 202 and the detected object sequence 531 (obtained from the 
t'th pixel block) and for each symbol position for J symbols detected beforehand, generates the symbol detection 

50 information 541 for M symbol candidates and outputs it to the detection result generation portion 550. The following is 
a description of j'th symbol detection (where 1 ::; j <J). 

[0176] Fig. 37 is flow chart showing the process of the symbol detection portion according to the fifth embodiment of 
the present invention. 

[0177] Step 551) The symbol detection information 541 successively generates symbol candidates c for 0 to M-1. 
55 and performs the following processing of from Step 552 through Step 553 for each of the symbol candidates. M is the 
maximum symbol value obtained from a symbol transform in the previously described first embodiment. 
[0178] Step 552) The following is a description of the symbol sequence generation portion 542. Fig. 38 is a diagram 
showing the configuration of the symbol sequence generation portion according to the fifth embodiment of the present 
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invention, and Fig. 39 is a flow chart showing the process of the symbol sequence generation portion according to the 
fifth embodiment of the present invention. 

[0179] Step 552-1) The symbol sequence generation portion 542 inputs the key 202 and the symbol candidate c, 
and the symbol sequence generation portion 542 takes a value which is the sum of c and the key 202 as the initial 
value when generating the spread sequence {r j (i> } (0^ i < n) for the length of the j'th item, and uses this as the symbol 
sequence 545 {p j (i) } (0^ i <n) (p 8 <i> :=r j 0) (0^ i < n) ). The symbol sequence 545 is sent to the symbol detection 
information generation portion 543. 

[0180] Step 553) The symbol detection information generation portion 543 inputs the detected object sequence 531 , 
the symbol sequence 545, the symbol candidate c and the symbol position j currently being processed, uses the 
following formula to determine a correlation value corr c (i>< l > between the symbol sequence 545 and the detected 
object sequence 531, and then generates the symbol detection information 4541 from the correlation value, symbol 
candidate, symbol position and pixel block. 



[0181] The symbol detection information 541 is sent to the detection result generation portion 550. 
[0182] The following is a description of the detection result generation portion 550. 

[0183] Fig. 40 is a diagram showing the configuration of the detection result generation portion according to the fifth 
embodiment of the present invention. The detection result generation portion 550 shown in the figure comprises a 
sequence generation portion 551 for each symbol position, a detected symbol generation portion 552 and an inverse 
symbol transform portion 553. 

[0184] Fig. 41 is a flow chart showing the process of the detection result generation portion according to the fifth 
embodiment of the present invention. 

[0185] Step 561) The detection result generation portion 550 inputs the symbol detect information 546 and take a 
detected symbol 555 as the detection result 203 (watermark). First, the sequence generation portion 551 for each 
symbol position divides the symbol detection information 541 of each symbol position j, and generates a symbol position 
sequence 554 of corr c <i)(t) (0 ^ c < M, 0< t < T) for each symbol position with a length MxT, for each j from j = 1 - J 
and sends the symbol position sequence 554 to the detected symbol generation portion 552. 

[0186] Step 562) The detected symbol generation portion 552 inputs the symbol position sequence 554 for each 
symbol position j. determines a symbol candidate cfor when the value of the correlation is the greatest for the sequence, 
for each symbol position, and generates a detected symbol s j (1 < j < J). 

[0187] Step 563) After all of the Sj have been determined, the inverse symbol transform portion 553 performs a 
transform from the symbol expression into the original watermark expression (for example, the inverse transform, 
corresponding to the transform in the first embodiment, is processing to regard the values for the four detected symbols 
(with the value for each of the detect symbols being from 0 to 255) as individual ASCII codes and convert them into 
four 8-bit characters), and generates and outputs the detection result 203. 

[0188] The detection result 203 indicates the watermark which is embedded in the detected object image. 
[0189] With watermark detection in the present embodiment, the detected object image (having a size of 2ISU 2N 
or more) is divided into blocks and the symbol when the value of the correlation is greatest for all of the blocks is 
detected so that, when compared to the previously described second embodiment, it is possible to perform a more 
accurate detection. 
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[Sixth Embodiment] 

50 

[0190] The following is description of a watermark detection portion of a sixth embodiment of the present invention. 
Portions other than those described below are the same as those of the previously described third embodiment. 
[0191] Fig. 42 is a diagram showing the configuration of the watermark detection portion according to the sixth em- 
bodiment of the present invention. The watermark detection portion 600 shown in the figure comprises a block division 
55 portion 610, a discrete Fourier transform portion 620. a detected object sequence generation portion 630. a symbol 
detection portion 640 and a detection result generation portion 650. 

[0192] Fig. 43 is a flow chart showing the process of the watermark detection portion according to the sixth embod- 
iment of the present invention. 
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[0193] Step 610) The watermark detection portion 600 inputs the detected object image 201 . detected object com- 
ponent position information 211 . offset information 231 and key 202 and outputs the watermark as the detection results; 
203. First, the block division portion 610 divides the detected object image 201 from the top left into blocks of N x N 
size as shown in Fig. 44, and uses the offset information (a, b). in the same manner as the block generation portion 

5 233 of the position marker detection portion 230, to perform cyclic offset for each block and generate T pixel blocks of 
the N x N size. Furthermore, the block division portion 610 gives the number 0 - T-1 to each of the pixel blocks obtained 
by the division. The processing from Step 620 through Step 640 is repeated for the t'th pixel block (0 H t <T). 
[0194] Step 620) The discrete Fourier transform portion 620 performs a discrete Fourier transform on the t'th pixel 
block 601 and obtains a detected object coefficient matrix 602. 

10 [0195] Step 630) The detected object sequence generation portion 630 uses processing the same as that of the 
detected object sequence generation portion 235 of the position marker detection portion 230 to obtain a detected 
object sequence 663 which is sent to the symbol detection portion 640. 

[0196] Step 640) The symbol detection portion 640 determines a value of the correlation between the detected object 
sequence and a sequence generated from the key 202. and generates symbol detection information 604. The process- 
es ing from Step 620 onwards is repeated for up to the T'th item. 

[0197] Step 650) Once the symbol detection information 604 has been obtained for each t, the detection result gen- 
eration portion 650 takes, as a detected symbol the symbol candidate value that has the correlation value for each of 
the symbol positions of the symbol detection information 604. 

[0198] Step 660) The detection result generation portion 650 determines the detected symbol from all of the symbol 
20 positions and outputs, as the detection result 203. the result of an inverse transform on the detected symbol into a 
watermark format. 

[0199] The following is a description of a symbol detection portion 640 in the present embodiment. 
[0200] Fig. 45 is a diagram showing the configuration of the symbol detection portion according to the sixth embod- 
iment of the present invention. The symbol detection portion 640 shown in the figure comprises a symbol candidate 
25 generation portion 641. a symbol sequence generation portion 643, and a symbol detection information generation 
portion 645. 

[0201] The symbol detection portion 640 inputs the key 202 and the detected object sequence 663 (obtained from 
the t'th pixel block) and outputs the symbol detection information 604. The symbol detection information 604 is gener- 
ated for the M symbol candidates 642. for each of the J symbol positions previously set for detection, and is output to 
30 the detection result generation portion 650. The following is a description of the j'th symbol detection (1 < j < J). 

[0202] Fig. 46 is a flow chart showing the process of the symbol detection portion according to the sixth embodiment 
of the present invention. 

[0203] Step 641 ) In the symbol candidate generation portion 641 . the symbol candidate c is successively generated 
for 0 to M-1 . and the processing from Step 642 to Step 643 is performed for each symbol candidate 642. M expresses 
35 the maximum value of the symbol value from a symbol transform in the previously described first embodiment. 

[0204] Step 642) Fig. 47 is a diagram showing the configuration of the symbol sequence generation portion according 
to the sixth embodiment of the present invention. Fig. 48 is a flow chart showing the process of the symbol sequence 
generation portion according to the sixth embodiment of the present invention. 

[0205] Step 642-1) The symbol sequence generation portion 643 inputs the key 202 and the symbol information c 
-to and takes the sum of the key 202 and the symbol information c as the initial value and generates the spread sequence 
{r j (i) } (OrS i < n) and uses this as it is, as the symbol sequence 644 (p j 0) } (Op j < n) (p i <i) ;rj 0 ) (0?f i < n)). The symbol 
sequence 644 is sent to the symbol detection information generation portion 645. 

[0206] Step 643) The symbol detection information generation portion 645 inputs the detected object sequence 603, 
the symbol sequence 644. the symbol candidate c and the symbol position j currently being processed, and uses the 
^5 following formula to determine the correlation value between the symbol sequence and detected object sequence, and 
generate the symbol detection information corr c ( i> M for sets of the correlation value, symbol candidate, symbol position 
and pixel block position. 
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[0207] The symbol detection information 604 is sent to the detection result generation portion 650. 

[0208] The following is a description of the detection result generation portion 650 in the present embodiment. 
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[0209] Fig. 49 is a diagram showing the configuration of the detection result generation portion according to the sixth 
embodiment of the present invention. The detection result generation portion 650 shown in the figure comprises a 
sequence generation portion 651 for each symbol position, a detected symbol generation portion 653. and an inverse 
symbol transform portion 655. 

5 [0210] Fig. 50 is a flow chart showing the process of the detection result generation portion according to a sixth 
embodiment of the present invention. 

[0211] Step 651) The detection result generation portion 650 inputs the symbol detect information 604 and. first of 
all, in the sequence generation portion 651 for each symbol position, divides the symbol detection information 604 for 
each symbol position j, and for j = 1- J generates a symbol position sequence corr c (i) (0 (0^ c < M. 0^ t < T) for each 
io symbol position of length M x T, and sends the symbol position sequence 652 to the detected symbol generation 
portion 653. 

[0212] Step 652) The detected symbol generation portion 653 inputs the symbol position sequence 652 for each 
symbol position j, finds the symbol candidate c for when there is the maximum correlation within the sequence for each 
symbol position, and generates a detected symbol Sj (15 j < J). This processing is repeated until all of the Sj are 
15 determined. 

[0213] Step 653) After all of the detected symbols s } have been determined, the inverse symbol transform portion 
655 converts from the symbol expression into the watermark expression (for example, with the inverse transform cor- 
responding to the first embodiment having four symbols (with the values of the four symbols (where the value of each 
symbol is from 0 - 255) being regarded as ASCII codes in processing for conversion into four 8-bit characters), and 
20 the detection result 203 is generated and output. The detection results 203 indicates the watermark embedded in the 
detected object image. 

[0214] With watermark detection according to the present embodiment, the minimum size of the detected object 
image becomes N x N and thereby enables detection from a smaller partial image than does the fifth embodiment. In 
addition, the number of blocks used for detection is larger than the number used by the fifth embodiment and so it is 
25 possible to perform detection at a higher accuracy than with the fifth embodiment. 

[0215] In addition, when compared to the third embodiment (which can only detect from one block), it is possible to 
perform higher accuracy detection. 

[Seventh Embodiment] 

30 

[0216] The following is a description of a watermark detection portion of a seventh embodiment of the present in- 
vention. Those portions not described below are the same as those of the previously described fourth embodiment. 
[0217] Fig. 51 is a diagram showing the configuration of the watermark detection portion according to the seventh 
embodiment of the present invention. The watermark detection portion 700 shown in the figure comprises a block 
35 division portion 710, a discrete Fourier transform portion 720. a detected object sequence generation portion 730. a 
symbol detection portion 740, and a detection result generation portion 750. 

[0218] Fig. 52 is a flow chart showing the process of the watermark detection portion according to the seventh em- 
bodiment of the present invention. 

[0219] Step 710) The watermark detection portion 700 inputs the detected object image 201, detected object com- 
-to ponent position information 211. offset information 231 and key 202. and. first of all, in the block division portion 710 
divides the detected object image 201 from the top left into blocks of N ^ N size as shown in Fig. 53. and uses the 
offset (a, b) in the same manner as the block generation portion 233 of the position marker detection portion 230, and 
performs cyclic shift for each block while generating T pixel blocks of the Nx N size. When this is done, those blocks 
around the edge of the detected object image 201 that do not make up an N x N size are cut for only that portion that 
45 corresponds to the detected object image 201 . and remaining portion of the Nx N block is filled with a mean value of 
the pixel values of the portion corresponding to the detected object image 201 . The block division portion 710 numbers 
each of the pixel blocks obtains by division, with a number from 0~ T-1 . 

[0220] Step 720) The discrete Fourier transform portion 720 perform a discrete Fourier transform on the t'th pixel 
block and obtains a detected object coefficient matrix 702. 
so [0221] Step 730) The detected object sequence generation portion 730 uses processing the same as that of the 
detected object sequence generation portion 235 of the position marker detection portion 230, to obtain a detected 
object sequence 703 and send it to the symbol detection portion 740. 

[0222] Step 740) The symbol detection portion 740 determines a correlation value of the detected object sequence 
703 and a sequence generated from the key 202. and then generates symbol detection information 704. 
55 [0223] Step 750) After the symbol detection information 704 has been obtained for each of the t. the detection result 
generation portion 750 makes the symbol candidate value of the symbol detection information 704 with the maximum 
correlation value into a detected symbol, for each of the symbol positions of the symbol detection information 704. 
[0224] Step 760) After the detected symbol has been determined from each of the symbol positions, the detection 
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result generation portion 750 inverse transforms the detected symbol into the watermark format and outputs the result 
as the detection result 203. 

[0225] The following is a description of the symbol detection portion 740 in the present embodiment. 

[0226] Fig. 54 is a diagram showing the configuration of the symbol detection portion according to the seventh em- 
5 bodiment of the present invention. The symbol detection portion 740 shown in the figure comprises a symbol candidate 

generation portion 741 , a symbol sequence generation portion 743 and a symbol detection information portion 745. 

[0227] The symbol detection portion 740 inputs the key 202 and the detected object sequence 703 (obtained from 

the t'th pixel block) and for each of the predetermined j symbol positions detected, generates the symbol detection 

information 704 for M symbol candidates 742 and outputs the symbol detection information 704 to the detection result 
10 generation portion 750. 

[0228] The following is a description of the j'th symbol detection (1^ j <J). 

[0229] Fig. 55 is a flow chart showing the process of the symbol detection portion according to the seventh embod- 
iment of the present invention. 

[0230] Step 741) The symbol candidate generation portion 741 successively generates symbol candidates c for 0 
is to M - 1 and performs the processing from Step 742 to Step 743 for each of the symbol candidates. M expresses the 
maximum value of the symbol value in the previously described first embodiment. 

[0231] Step 742) The following is a description of the configuration and process of the symbol sequence generation 
portion 743. Fig. 56 is a diagram showing the configuration of the symbol sequence generation portion according to 
the seventh embodimentof the present invention and Fig. 57 is a flow chart showingthe process of the symbol sequence 

20 generation portion according to the seventh embodiment of the present invention. 

[0232] Step 742-1) The symbol sequence generation portion 743 inputs the key 202 and the symbol candidate c, 
and takes a value which is the sum of c and the key 202 as the initial value when the spread sequence generator 7431 
generates a j'th spread sequence {r W } (0^ i < n) and output it as a symbol sequence 744 {p x ti> } (O*- i < n) (p j *i> : 
=r j W (0 ^ i <n) ). The symbol sequence 744is sent to the symbol detection information generation portion 745. 

25 [0233] Step 743) The symbol detection information generation portion 745 inputs the detected object sequence 703, 
the symbol sequence 744. the symbol candidate c and the symbol position j currently being processed, uses the 
following formula to determine the correlation value of the symbol sequence 744 and the detected object sequence 
703. groups the correlation value, symbol candidate, symbol position and the pixel block position and generates the 
symbol detection information corr c U) < l > . 
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40 [0234] The symbol detection information 704 is sent to the detection result generation portion 750. 

[0235] The following is description of the detection results generation portion 750 in the present embodiment. 
[0236] Fig. 58 is a diagram showing the configuration of the detection result generation portion according to the 
seventh embodimentof the present invention. The detection resultgeneration portion 750 shown in the figure comprises 
the sequence generation portion 751 for each symbol position, a detected symbol generation portion 753 and an inverse 

45 symbol transform portion 755. 

[0237] Fig. 59 is a flow chart showing the process of the detection result generation portion according to the seventh 
embodiment of the present invention. 

[0238] Step 751) The detection resultgeneration portion 750 inputs the symbol detection information 704, and first 
of all, in the sequence generation portion 751 for each symbol position, divides the symbol detection information 704 

50 into each symbol position j, generates a symbol position sequence corr c H> < l > (0 < c < M .0^ t < T) of length M * T 
for each of j = 1 — J. and sends the symbol position sequence 752 to the detected symbol generation portion 753. 
[0239] Step 752) The detected symbol generation portion 753 inputs the symbol position sequence 752 for each 
symbol position, finds a symbol candidate c having the maximum correlation value in the sequences for each symbol 
position j, and generates a detected symbol s } (0 ■ j< J). The processing of Step 751 and Step 752 is repeated until 

55 all Sj are determined. 

[0240] Step 753) After all Sj are determined, the inverse symbol transform portion 755 transforms the symbol ex- 
pression into a watermark expression (for example, with the inverse transform corresponding to the first embodiment 
having four symbols (with the values of the four symbols (where the value of each symbol is from 0 - 255) being 
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regarded as ASCII codes in processing for conversion into four 8-bit characters), and generates and outputs the de- 
tection result 203. 

[0241] The detection result 203 indicates the watermark embedded in the detected object image 201 . 
[0242] With the watermark detection in the present embodiment, there is no limit relating to a minimum size of the 
detected object image and so it is possible to perform detection from a partial image smaller than that of the previously 
described sixth embodiment. In addition, the number of blocks used for detection is greater than for the sixth embod- 
iment and so it is possible to perform detection at a higher accuracy when compared to the sixth embodiment. In 
addition, it is also possible to perform detection at a higher accuracy when compared to the fourth embodiment (which 
only uses one block for detection). 

[Eighth Embodiment] 

[0243] The following is a description of the position marker detection portion that uses offset candidate information 
to divide the detected object image into blocks and outputs an addition block which is the sum of the pixel values of 
the pixel blocks. Those portions not described in the following are the same as those of the previously described second 
embodiment. 

[0244] Fig. 60 is diagram showing the configuration of a block generation portion of a position marker detection portion 
according to an eighth embodiment of the present invention. 

[0245] The block generation portion 800 of the position marker detection portion 230 has a block division portion 
810 and a block addition portion 820. 

[0246] Fig. 61 is a flow chart showing the process of the block generation portion of the position marker detection 
portion according to the eighth embodiment of the present invention. 

[0247] Step 810) The block generation portion 800 inputs the detected object image 201 and the offset candidate 
information 204 and in the block division portion 810, divides the detected object image 201 into TN a N sized pixel 
blocks displaced from the top left of the detected object image 201 by the offset candidate information 204 (a. b) as 
shown in Fig. 62. 

[0248] Step 820) Next, the block addition portion 820 adds all of the blocks and generates the addition block 802. 
When a block is expressed as a formula. 

B .. {0 := t'th block (0^ i< N. 0< j< N. 0^ t< T). 
the addition block A ,j (0^ i< N. 0^ j< N) is obtained by 

A i> =i: o B ,,'<> ( 0 ^ i < N , 0^ j < N ) 

[0249] Step 830) The block generation portion 800 outputs the addition block 802 to the discrete Fourier transform 
portion 234 as the pixel block 205. 

[0250] The following is a description of the block generation portion 241 of the watermark detection portion 240 in 
the present embodiment. 

[0251] The block generation portion 241 of the watermark detection portion 240 inputs the detected object image 
201 and the offset information, and, in the same manner as the block generation portion 233 of the position marker 
detection portion 230. (inputs the offset information as the offset candidate information and) divides the detected object 
image 201 into T N a N sized blocks displaced by the offset information (a. b). Then, the block generation portion 241. 
adds these displaced blocks and generates an addition block. This addition block is then output to the discrete Fourier 
transform portion 242 as the pixel block 246. 

[0252] The watermark detection in the present embodiment is performed by dividing the detected object image (of 
size 2Nx 2N or more) into blocks of N x N size, detecting the position marked from the block which is the sum of all 
blocks and detecting the watermark. 

[0253] Because of the addition of the T blocks, the watermark pattern which is a repeated pattern of the N x N size 
is emphasized T times while the pattern of the original image has a lower correlation between blocks and so is gradually 
cancelled by the addition. This is to say that the detection from the addition block reduces the influence of the original 
image and at the same time emphasizes the watermark pattern so that it is possible to perform detection at a higher 
accuracy than with the previously described second embodiment. 

[0254] In addition, when compared to the second embodiment, the amount of processing required for detection 
increases by the portion required to generate the addition block but this amount of processing is so small that it can 
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be ignored when compared to the amount of processing for the other portions of the detection processing. Furthermore, 
it is also possible to perform high-speed processing several times faster when compared to detecting one block at a; 
time as in the fifth embodiment. 

5 [Ninth Embodiment] 

[0 255] The following is a description of a ninth embodiment, of the position marker detection portion and the water- 
mark detection portion which perform processing to divide the detected object image into blocks, and make an addition 
block by adding the pixel values of the divided blocks, use the offset information to perform cyclic offset of this addition 
w block and generate a pixel block. Moreover, those portions that are not described in the following are the same as 
those of the previously described third embodiment. 

[0256] Fig. 63 is a diagram showing the configuration of the block generation portion of the position marker detection 
portion according to the ninth embodiment of the present invention. The block generation portion 900 shown in the 
figure comprises a block division portion 910, a block addition portion 920 and a cyclic shift portion 930. 
15 [0257] Fig. 64 is a flow chart showing the process of the block generation portion of the position marker detection 
portion according to the ninth embodiment of the present invention. 

[0258] Step 910) The block generation portion 900 inputs the detected object image 201 and the offset candidate 
information 204 and. in the block division portion 910, divides the detected object image 201 from the top left into T 
blocks of Nx N size, as shown in Fig. 65. 
20 [0259] Step 920) Next, the block addition portion 920 adds all of these blocks and generates the addition block 902. 
When a block is expressed as a formula 
B j| <■> ; t'th block (0 ^ i< N. 0^ j< N, 0^ t<T). 
the addition block A tl (Qfk i< N, 0^ j< N) is obtained by 

25 

A 4j = ±: B i -j < 1 1 (OS i < N , 0 <; j < N ) 

t — o 

[0260] The following is a description of the process of the cyclic shift portion 930 in the block generation portion 900 
30 of the position marker detection portion 230 in the present embodiment. 

[0261] Fig. 66 is a diagram describing the process of the cyclic shift portion of the block generation portion according 
to the ninth embodiment of the present invention. 

[0262] As shown in the figure, the cyclic shift portion 930 uses the offset candidate information 204 as the basis for 
cyclic shift of the addition block # 902 and generates the pixel block 205. 
■*5 [0263] The pixel block 203 is output to the discrete Fourier transform portion 234. When the addition block is described 
Ay : addition block (0^ i< N. 0^ j< N). the pixel block 246 obtained by cyclic shift using the offset candidate 
information (a, b) is obtained by 

[0264] The following is a description of the block generation portion (not shown in the figure) of the watermark de- 
tection portion 240 in the present embodiment. 

[0265] The block generation portion 241 of the watermark detection portion 240 inputs the detected object image 
« 201 and the offset information 231 and, in the same manner as the block generation portion 900 of the position marker 
detection portion 230, (inputs the offset information as offset candidate information and) divides the detected object 
image 201 from the top left into T blocks of N ^ N pixels. 

[0266] Then, an addition portion inside the block generation portion 241, adds all of these blocks and generates an 
addition block. Then, in a cyclic shift portion of the block generation portion 241 . the offset information is used as the 
50 basis for cyclic shift of the addition block to generate the pixel block 246. which is output to the discrete Fourier transform 
portion 242. 

[0267] The watermark detection in the present embodiment has a necessary minimum size of N a N pixels for the 
detected object image and therefore enables detection from a detected object image much smaller than in the eighth 
embodiment. 

55 [0268] Furthermore, when compared to the eighth embodiment, the number of divided blocks T is larger and so. 
when there is detection, the influence of the original image is lessened and the watermark pattern is emphasized so 
that it is possible to perform detect at a higher accuracy than with the eighth embodiment. 

[0269] Also, since adding the blocks means that the influence of the original image is lessened when there is detection 
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and that the watermark pattern is emphasized, it is possible to perform detection at higher accuracy than with the third 
embodiment. 

[0270] In addition, when compared to the third embodiment, the amount of processing required for detect increases 
by the amount required to generate the addition block, but when compared to the amount of processing for portions 
5 of the detection processing, is so small that it can be ignored. In addition, when compared to detection such as in the 
sixth embodiment which performs detection for one block at a time, it is possible to perform processing that is several 
times faster. 

[Tenth Embodiment] 

w 

[0271] The following is a description of a tenth embodiment of the position marker detection portion 230. Portions 
not described in the following are the same as the previously described fourth embodiment. 

[0272] In the present embodiment, the position marker detection portion 230 divides the detected object image into 
blocks and, when it does, a block at an edge of the detected object image may have an empty portion. In this case, a 
75 mean value is determined for pixel values of a portion of the block including the detected object image, and the empty 
portion of the block is filled with the mean value. The present embodiment therefore differs from the ninth embodiment 
in this respect. 

[0273] Fig. 67 is diagram showing the configuration of the block generation portion of the position marker detection 
portion according to the tenth embodiment of the present invention. The block generation portion 1000 comprises a 
20 block division portion 1010, a block addition portion 1020 and a cyclic shift portion 1030. 

[0274] Fig. 68 is a flow chart showing the process of the block generation portion of the position marker detection 
portion of the tenth embodiment of the present invention. 

[0275] Step 1010) The block generation portion 1000 inputs the detected object image 201 and the offset candidate 
information 204 and as shown in Fig. 69, the block division portion 1010 divides the detected object image 201 from 
25 the top left into T blocks of N x N pixels. When it does this, as shown in Fig. 70, an empty portion of a block at an edge 
of the detected object image is filled with a mean value of the pixel values of the portion of the block including the 
detected object image 201. 

[0276] Step 1020) Then, in the block addition portion 1020, all of these blocks are added and an addition block 1012 
is generated. Expressing a block as a formula gives 
30 B jj W : t'th block (0 =s i< N, 0^ j< N,0 < t < T) 

and the addition block A ,j (0 ?_ : i< N. 0-r j< N) is obtained by 

35 A^^i^B,^'* <0<i<N,OSj<N) 

[0277] The following is a description of the process of the cyclic shift portion 1030 in the block generation portion 
1000 of the position marker detection portion 230 in the present embodiment. 

[0278] Fig. 71 is a diagram showing the process of the cyclic shift portion according to the tenth embodiment of the 
to present invention. 

[0279] The cyclic shift portion 1030 uses the offset candidate information 204 as the basis for cyclic shift of the 
addition block 1012 and generates the pixel block 205. The pixel block 205 is output to the discrete Fourier transform 
portion 234. Expressing the addition block 1012 as a formula gives 

A ^ : addition block (0$ i< N. 0^ j< N) and the pixel block 205 obtained by cyclic shift using the offset candidate 
*5 information (a, b) is obtained by 

C ij =A (Ka)%N. ij+ b) %N (0 ^i<N,0^j< N) 

50 [0280] The following is a description of the block generation portion (not shown in the figure) of the watermark de- 
tection portion in the tenth embodiment of the present invention. 

[0281] The block generation portion of the watermark detection portion in the tenth embodiment of the present in- 
vention inputs the detected object image and the offset information, and in the same manner as the block generation 
portion of the position marker detection portion, (inputs the offset information as the offset candidate information and), 
55 divides the detected object image from the top left into T blocks of N pixels. 

[0282] Then, a block addition portion, adds all of the blocks to generate an addition block. Then, a cyclic shift portion 
uses the offset information as the basis for cyclic shift of the addition block and generates the pixel block 246 which is 
then output to the discrete Fourier transform portion 2-12 
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[0283] Watermark detection in the present embodiment has an arbitrary size for a minimum necessary size of the 
detected object image and enables detection from a detected object image smaller than that for the ninth embodiment. ; 
[0284] Futhermore. the number of divided blocks T is smaller than for the ninth embodiment and so the influence of 
the original image is lessened when there is detection, and the watermark pattern is more emphasized, so that it is 
5 possible to perform detection at a higher accuracy than for the ninth embodiment. 

[0285] In addition, since the addition of the blocks reduces the influence of the original image when there is detection 
and emphasizes the watermark pattern, it is possible to perform detection at a higher accuracy than for the fourth 
embodiment. 

[0286] In addition, when compared to the fourth embodiment, the amount of processing required for the watermark 
W detection increases by the amount needed to generate the addition block, but when compared to the amount of process- 
ing for other portions of the detection processing, it is small enough to be ignored. Furthermore, it is also possible to 
perform processing that is faster in proportion to the number of blocks, when compared to the seventh embodiment 
that performs detection for one block at a time. 

'5 [Eleventh Embodiment] 

[0287] The following is a description of a watermark detection apparatus according to an eleventh embodiment of 
the present invention. 

[0288] The watermark detection apparatus according to the present embodiment is an apparatus for detecting an 
20 embedded watermark from an image resulting from processing (such as partial cutting, irreversible compression or 

the like) being applied to an embedding obtained using the method of the first embodiment, described above. 

[0289] Fig. 72 is a diagram showing the configuration of the watermark detection apparatus according to the eleventh 

embodiment of the present invention. The watermark detection apparatus 1100 shown in the figure comprises a position 

marker detection portion 1110, a position marker sequence generating portion 1120, a detected object component 
25 specification portion 1130 and a watermark detection portion 1140. 

[0290] Fig. 73 is a diagram showing the configuration of the watermark detection apparatus according to the eleventh 

embodiment of the present invention. 

[0291] Step 1110) The watermark detection apparatus 1100 inputs the detected object image 201 and the key 202 
used when there was embedding. First, in the detected object component specification portion 1130 of the information 
30 detection apparatus 1100. a method the same as that used by the embedding object component specification portion 
130 in the previously described first embodiment is used to generate detected object component position information 
1103 from the key 202, and then send this detected object component position information 1103 to the position marker 
detection portion 1110 and the watermark detection portion 1140. 

[0292] Step 1120) The position marker sequence generating portion 1120 generates a position marker sequence 
35 1102 from the key 202 and sends the position marker sequence 1102 to the position marker detection portion 1110. 
[0293] Step 1130) The position marker detection portion 1110 cuts pixel blocks of N x N size (where N is the size 
of the embedded watermark pattern in the first embodiment) from the top left of the detected object image 201 and 
outputs offset information 1101 which indicates the degree to which the start point of the embedded watermark pattern 
is displaced from the start point of the cut pixel block, and sends it to the watermark detection portion 1140. 
40 [0294] Step 1140) The watermark detection portion 1140 inputs the detected object image 201. the key 202. the 
detected object component position information 1103 and the offset information 1101. cuts N x N size pixel blocks 
from the top left of the detected object image 201. and uses the offset information 1101 , the key 202 and the detected 
object component position information 1103 to detect the watermark embedded in the pixel block and output the de- 
tection result 203. 

45 [0295] The following is a description of the detected object component specification portion 1130 in the present 
embodiment. 

[0296] Fig. 74 is a diagram showing the configuration of the detected object component specification portion according 
to the eleventh embodiment of the present invention, and Fig. 75 is a flow chart showing the process of the detected 
object component specification portion according to the eleventh embodiment of the present invention. 

50 [0297] Step 1111) The detected object component specification portion 1130 inputs the key 202 and uses a random 
number generator 1131 to generate a random number sequence that has the key 202 as an initial value. 
[0298] Step 1112) Futhermore. the detected object component specification portion 1130 uses the generated random 
number sequence as the basis for generating the detected object component position information 1103 which is a 
sequence having the same length as the length n of the embedding sequence used in the first embodiment. The 

55 detected object component position information 1103 is configured as follows. 

L k - .-x. v, z k }(0 k < n) 



26 



EP 1 022 678 A2 



x k : embedding object component coefficient x-direction second degree; 
y k : embedding object component coefficient y-direction second degree; 

z k ; flag expressing real or imaginary for the embedding object coefficient (where or not it is a real number com- 
ponent or an imaginary number component) 

[0299] The.detected object component specification portion 11 30 performs exactly the same process as the embed- 
ding object component specification portion in the first embodiment. That is to say. it inputs the same key, and the 
embedding object component position information generated by the embedding object component specification portion 
of the first embodiment is exactly the same as the detected object component position information 11 03 generated by 
the detected object component specification portion 1130 of the present embodiment. The generated detected object 
component position information 1103 is sent to the position marker detection portion 1110. 

[0300] The following is a description of the position marker sequence generating portion 11 20 in the present embod- 
iment. 

[0301] Fig. 76 is diagram showing the configuration of the position marker sequence generating portion according 
to the eleventh embodiment of the present invention and Fig. 77 is a flow chart showing the process of the position 
marker sequence generating portion according to the eleventh embodiment of the present invention. 
[0302] Step 1121) The position marker sequence generating portion 1120 inputs the key 202 and uses a spread 
sequence generator 1121 to generate a spread sequence {r ^ 0) } (0^ i < n) of O'th length n and having the key 202 as 
its initial value, and uses this spread sequence as it is as the position marker sequence {p j } (0^ i < n) (pj : =r j <°> (0'~- 
i < n)). The spread sequence generator 1121 of the position marker sequence generating portion 11 20 uses an process 
the same as the spread sequence generator 122 of the position marker sequence generating portion 120 of the first 
embodiment. 

[0303] The following is a description of the position marker detection portion of the present embodiment. 
[0304] Fig. 78 is a diagram showing the configuration of the position marker detection portion of the eleventh embod- 
iment of the present invention. 

[0305] The position marker detection portion 1110 shown in the figure comprises a block generating portion 1111. a 
discrete Fourier transform portion 1113. a detected object sequence generating portion 1115. an offset candidate in- 
formation generating portion 1117. a position marker detection information generating portion 1118. and an offset in- 
formation generating portion 1119. 

[0306] Fig. 79 is a flow chart showing the process of the position marker detection portion of the eleventh embodiment 
of the present invention. 

[0307] Step 1131) The position marker detection portion 1110 inputs the detected object image 201, the detected 
object component position information 11 03. and the position marker sequence 1102 and first of all, in the block gen- 
erating portion 1111, cuts pixel blocks of N ^ N size from the top left of the detected object image 201 . 
[0308] Step 1132) Next, the discrete Fourier transform portion 1113 performs a discrete Fourier transform on the 
pixel block 1104 and generates a detected object coefficient matrix 1105. 

[0309] Step 1133) Next, the offset candidate information generating portion 1117 successively generates offset can- 
didate information (a. b) for (0, 0) to (N - 1 . N - 1 ). 

[0310] Step 1134) Next, the processing for the detected object sequence generating portion 1115 to the position 
marker detection information generating portion 1118 is performed for each of the offset candidate information 1106. 
The detected object sequence generating portion 1115 inputs the detected object component position information 1103. 
the detected object coefficient matrix 11 05 and the offset candidate information 11 06 and generates a detected object 
sequence 1107 as follows. Fig. 80 is a flow chart showing the process of the detected object sequence generating 
portion of the position marker detection portion of the eleventh embodiment of the present invention. 
[0311] Step 1 1 34-1 ) The detected object sequence generating portion 1115 expresses the detected object coefficient 
matrix 1105 as F(u. v) (0^ u < N, 0^ v < N). the detected object component position information 1103 as L k = (x k . 
y k ,z k ) (Or? k < n) . the offset candidate information 1106 as (a. b) and the detected object sequence 1107 as {q k } (0^ 
k < n). 

[0312] When z k is a value that expresses a real number component, there is a shift to Step 1134-2 and when z k is 
a value that express an imaginary number component, there is a shift to Step 11 34-3. 
[0313] Step 1134-2) Processing for the real number component of 

ax 1 +byk 
r- t ^ N 

:=F ( x k-y k > - e 

is performed for k = 0 - n-1 

[0314] Step 1134-3) Processing for the imaginary number component of 
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a x1 +byk 

q k :=F(x k .y k ) x e 



is performed for k = 0 - n-1 . 

[0315] Step 1134-4) The detected object sequence {q K } is output. 

[0316] Step 1135) Next, the position marker detection information generating portion 1118 uses the following formula 
to determine the value of the correlation between the position marker sequence 1102 and the detected object sequence 
1107, group it with the offset candidate information 1106 and output it as N the position marker detection information 
corr ab . 



SI C P. ' q, ) 

i - o 



corr 



Pi 



q, 2 



[0317] The processing from the detected object sequence generating portion 1115 and the position marker detection 
information generating portion 1118 is repeated until the offset candidate information (a, b) has passed from (0, 0) - 
(N - 1, N - 1). and all of the position marker detection information 1108 is sent to the offset information generating 
portion 1119. 

[0318] Step 1136) The offset information generating portion 1119 takes the offset candidate information (a. b) for that 
item of input position marker detection information 1108 for which the value of the correlation between the position 
marker sequence 1102 and the detected object sequence 1109 is greatest, outputs it as the offset information 1101 
and sends it to the watermark detection portion 1140. 

[0319] The offset information 1101 output from the position marker detection portion 1110 indicates the degree to 
which the start point of the watermark pattern was offset from the top left of the detected object image 201 when it was 
embedded. 

[0320] The following is a description of the watermark detection portion 1140 in the present embodiment. 
[0321] Fig. 81 is a diagram showing the configuration of the watermark detection portion according to the eleventh 
embodiment of the invention. The watermark detection portion 1140 in the figure comprises a block generating portion 
1141 , a discrete Fourier transform portion 1143, a detected object sequence generating portion 1145, a symbol detec- 
tion portion 1147 and a detection result generating portion 1149. 

[0322] Fig. 82 is a flow chart showing the process of the watermark detection portion according to the eleventh em- 
bodiment of the present invention. 

[0323] Step 1141) The block generating portion 1141 inputs the detected object image 201 , detected object compo- 
nent position information 1103. offset information 1101 and key 202 and. first of all. in the block generating portion 
1141, cuts pixel blocks 1142 of a size Nx N from the top left of the detected object image 201, and sends the pixel 
blocks 1142 to the discrete Fourier transform portion 1143. 

[0324] Step 1142) The discrete Fourier transform portion 1143 performs a discrete Fourier transform on the pixel 
blocks 1142 and generates are detected object coefficient matrix 1144 which is then sent to the detected object se- 
quence generating portion 1145. 

[0325] Step 1143) The detected object sequence generating portion 1145 obtains a detected object sequence 1146 
(using the offset information 1101 as the offset candidate information) by a processing the same as that of the detected 
object sequence generating portion 11 15 of the position marker detection portion 1110. and sends the detected object 
sequence 1146 to the symbol detection portion 1147. 

[0326] Step 1144) The symbol detection portion 1147 determines the value of the correlation between the detected 
object sequence 1146 and a sequence generated from the key 202. and generates symbol detection information 1148. 
[0327] Step 1145) The detection result generating portion 1149 obtains the symbol detection information 1148 and 
then, for each of symbol positions of the symbol detection information 1148, selects, as a detected symbol, a symbol 
candidate value having a maximum value of the correlation. 

[0328] Step 1146) After all of the detected symbols have been determined from all of the symbol positions, a result 
of performing aainverse transform on the detected symbol to produce a watermark is output as the detection result 203. 
[0329] The following is a description of the symbol detection portion 1147 in the present embodiment. 
[0330] Fig. 83 is diagram showing the configuration of the symbol detection portion according to the eleventh em- 
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bodiment of the present invention. In the figure, the symbol detection portion 1147 comprises a symbol candidate 
generating portion 11471 . a symbol sequence generating portion 11473 and a symbol detection information generating 
portion 11475. The symbol detection portion 1147 inputs the key 202 and the detected object sequence 1146 and for 
each of predetermined J symbol positions detected, generates the symbol detection information 1148 for M symbol 
5 candidates, and outputs the symbol detection information 1148 to the detection result generating portion 1149. The 
following is a description of the j'th (1:? j < J) symbol detection. 

[0331] Fig. 84 is a flow chart showing the process of the symbol detection portion according to the eleventh embod- 
iment of the present invention. 

[0332] Step 1144-1) The symbol candidate generating portion 11471 successively generates symbol candidates c 
w from 0 to M - 1. and the processing from Step 1144-2 - Step 1144-3 is performed for each symbol candidate. M 
expresses the maximum value of the symbol value due to symbol conversion in the previously described first embod- 
iment. 

[0333] Step 1144-2) The following is a description of the symbol sequence generating portion 11473. 
[0334] Fig. 85 is diagram showing the configuration of the symbol sequence generating portion according to the 
15 eleventh embodiment of the present invention and Fig. 86 is a flow chart showing the process of the symbol sequence 
generating portion according to the eleventh embodiment of the present invention. 

[0335] Step 1144-2-1) The symbol sequence generating portion 11473 inputs the key 202 and the symbol candidate 
c, and takes a value which is the sum of c and the key 202 as an initial value for a spread sequence generator 114731 
generating the j'th spread sequence {r ( 0) } of length n. which is used as it is as a symbol sequence 11474 { p } <i) } (0^ 
20 j < n) (pj <j> := r j <i> (0 5* j < n) ). The symbol sequence 11474 is sent to the symbol detection information generating 
portion 11475. 

[0336] Step 1144-3) The symbol detection information generating portion 11475 inputs the detected object sequence 
1146. the symbol sequence 11474. the symbol candidate c and the symbol position j that is currently being processed 
and uses the following formula to determined the value of the correlation between the symbol sequence 11474 and 
25 the detected object sequence 1146. The correlation value, the symbol candidate and the symbol position are then 
grouped and the symbol detection information corr c ti) generated. 

fc" 1 ( P, ( " ' q , ) 

30 

corr := 

1 

35 [0337] The symbol detection information 1148 is sent to the detection result generating portion 1149. 
[0338] The following is a description of the detection result generating portion 1149. 

[0339] Fig. 87 is diagram showing the configuration of the detection result generating portion according to the eleventh 
embodiment of the present invention. The detection result generating portion 1149 shown in the figure comprises a 
sequence generating portion 11491 for each of the symbol positions, a detected symbol generating portion 11493 and 
40 an inverse symbol transform portion 11495. 

[0340] Fig. 88 is a flow chart showing the process of the detection result generating portion according to the eleventh 
embodiment of the present invention. 

[0341] Step 1145-1) The detection result generating portion 1149 inputs the symbol detection information 1148 and 
first of all. in the sequence generating portions 11491 for each of the symbol positions, divides the symbol detection 
^5 information 1148 for each symbol position j. and generates a symbol position sequence 

corr c tj> . (05 c< M) 

so of length M for each of the symbol positions for j=1 -J. and sends the symbol position sequence 11492 to the detected 
symbol generating portion 11493. 

[0342] Step 1145-2) The detection symbol generating portion 11493 inputs the symbol position sequence 11492 for 
each of the symbol positions and finds the symbol candidate c in the sequence for each symbol position j. for which 
the value of the correlation is maximum, and generates a detected symbol s j (1 « j < J). 
55 [0343] Step 1145-3) After all of the Sj have been determined, the inverse symbol transform portion 11495 transforms 
from symbol expression into the original watermark expression (with, for example, the inverse transform corresponding 
to the transform in the first embodiment having four symbols (where the value of each symbol is from 0-255) being 
regarded as ASCII code in processing for conversion into four 8-bit characters), and generates and outputs the detection 
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result 203. 

[0344] The detection result indicates the watermark embedded in the detected object image 201. 
[0345] This ends the processing for the watermark detection apparatus in the eleventh embodiment. 
[0346] Watermark detection in the present embodiment involves cutting a block from the top left of the detected 
object image, performing a discrete Fourier transform and obtaining the detected object coefficient matrix 1105, and 
then multiplying a phase difference determined by the second degree of the coefficient and the offset, with the com- 
ponent specified by the detected object component position information 1103, and generating the detected object 
sequence. The aspect relating to the parallel displacement of the Fourier transform uses 

0 .a u+b-u 
" 2 — N — 
F(u.v) < > f(x-a. y-b) 

(with < > expressing a Fourier transform/inverse transform). By this, the discrete Fourier transform necessary when 

there is detection is only applied once, and it is possible to perform processing that is faster than the detection process- 
ing of the first through the tenth embodiments. Using a computer simulation for a comparison of the processing times 
for a block size of N = 1 28 gave a second embodiment to eleventh embodiment ratio of 65:1 . 

[0347] In addition, it is possible to perform detection when there is a partial image (of size N a N or more) cut from 
an arbitrary position of an embedded image embedded with a watermark according to the first embodiment. 

[Twelfth Embodiment] 

[0348] The following is a description of a twelfth embodiment, using an example of a block generating portion in the 
position marker detection portion. In this embodiment, the block generating portion, when the detected object image 
is divided into blocks, determines an average value of a portion of a block including the detected object image, and a 
remaining empty portion of the block is filed with the average value. In the following description, those portions that 
are not described are the same as the previously described eleventh embodiment. 

[0349] Fig.89 is a diagram describing the process of the block generating portion of the position marker detection 
portion according to the twelfth embodiment of the present invention. 

[0350] The block generating portion 1111 of the position marker detection portion 1110 inputs the detected object 
image 201 and cuts blocks of N x N size from the top left of the detected object image. If the detected object image 
is smaller than the N x N size, a portion of a block containing the detected object image is cut (see A in the figure), 
and the remaining empty portion is filled with a mean value of the pixel value of the portion containing the detected 
object image. 

[0351] A block obtained by this processing is output as a pixel block in the same manner as the previously described 
eleventh embodiment. 

[0352] The following is a description of the block generation process of the watermark detection portion in the present 
embodiment. The block generation process of the watermark detection portion in the present embodiment inputs the 
detected object image, and uses a processing the same as that of the block generating portion in the position marker 
detection portion to obtain and output a pixel block. 

[0353] When compared to the previously described eleventh embodiment, watermark detection using the present 
embodiment uses an arbitrary size from the necessary size of N x N or more and therefore enables detection from a 
smaller detected object image. 

[Thirteenth Embodiment] 

[0354] The following is a description of a thirteenth embodiment of the present invention, for the watermark detection 
portion, the symbol detection portion and the detection result generating portion. Those portions not described in the 
following are the same as those of the previously described eleventh embodiment. 

[0355] Fig. 90 is a diagram showing the configuration of the watermark detection portion according to the thirteenth 
embodiment of the present invention. The watermark detection portion 2000 shown in the figure comprises a block 
division portion 21 00, a discrete Fourier transform portion 2200, a detected object sequence generating portion 2300, 
a symbol detection portion 2400. and a detection results generating portion 2500. 

[0356] Fig. 91 is a flow chart showing the process of the watermark detection portion according to the thirteenth 
embodiment of the present invention. 

[0357] Step 2100) The watermark detection portion 2000 inputs the detected object image 201. the detected object 
component position information 211, the offset information 231 and the key 202 and first of all. in the block division 
portion 2100 divides the detected object image 201 from the top left into T pixel blocks 2001 of N ^ N size as shown 
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in Fig. 92. 

[0358] Step 2200) The pixel blocks 2001 obtained by division are given numbers from 0 - T-1. The processing of 
Step 2300- Step 2400 is repeated for the t'th pixel block (0^ t < T). 

[0359] Step 2300) The discrete Fourier transform portion 2200 performs a discrete Fourier transform on the t'th pixel 
5 block to obtain a detected object coefficient matrix 2002. 

[0360] Step 2400) The detected object sequence generating portion 2300 performs a processing the same as that 
of the detected object sequence generating portion of the position marker detection portion to obtain a detected object 
sequence 2003 which is then sent to the symbol detection portion 2400. 

[0361] Step 2500) The symbol detection portion 2400 determines the value of the correlation between the detected 
10 object sequence 2003 and a sequence generated from the key 202, and generates symbol detection information 2004. 
[0362] Step 2600) The detection result generating portion 2500 obtains the symbol detection information 2004 for 
each t, and then for each symbol position of the symbol detection information 2004, selects a detected symbol having 
a maximum value of the correlation from all of the symbol positions, and outputs a result of performing an inverse 
transform on the detected symbol to produce a digital watermark, as a detection result. 
15 [0363] The following is a description of the symbol detection portion 2400 in the present embodiment. 

[0364] Fig. 93 is diagram showing the configuration of the symbol detection portion according to the thirteenth em- 
bodiment of the present invention. The symbol detection portion 2400 in the figures comprises a symbol candidate 
generating portion 2410, a symbol sequence generating portion 2420 and a symbol detection information generating 
portion 2430. 

20 [0365] The symbol detection portion 2400 inputs the key 202 and the detected object sequence 2003 (obtained from 
the t'th pixel block) and generates symbol detection information 2004 for M symbol candidates for each symbol positions 
for a predetermined number J of detected symbols, and outputs the symbol detection information 2004 to the detection 
result generating portion 2500. 

[0366] Fig. 94 is a flow chart showing the process of the a symbol detection portion of the thirteenth embodiment of 
25 the present invention. 

[0367] Step 2410) The symbol candidate generating portion 2410 successively generates symbol candidates c from 
0- M-1 and repeats the processing of Step 2420- Step 2430 for each symbol candidate. M expresses the maximum 
value for the symbol value due to symbol transform in the first embodiment. 

[0368] Step 2420) The following is a description of the symbol sequence generating portion 2420. Fig.95 is a diagram 
30 showing the configuration of the symbol sequence generating portion according to the thirteenth embodiment of the 
present invention, and Fig. 96 is a flow chart showing the process of the symbol sequence generating portion according 
to the thirteenth embodiment of the present invention. 

[0369] Step 2421) The symbol sequence generating portion 2420 inputs the key 202 and the symbol candidate c. 
and uses the sum of the key 202 and the symbol candidate c as an initial value for a spread sequence generator 2421 
35 generating the j'th spread sequence {r j 'J) } of length n. and using it as it is as the symbol sequence 2402. 

(Pi <j) }{0 * i<n)( Pi (j) -r, (0 (0^ i < n)) . 

40 The symbol sequence 2402 is sent to the symbol detection information generating portion 2430. 

[0370] Step 2430) The symbol detection information generating portion 2430 inputs the detected object sequence 
2003. the symbol sequence symbol 2402, the symbol candidate c and uses the symbol position j that is currently being 
processed, and the following formula to determine the value of the correlation between the symbol sequence 2402 
and the detected object sequence 2003. group the correlation value, the symbol candidated, symbol position j and the 

45 pixel block position and generate the symbol detection information corr c (i) (*)- 
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[0371] The symbol detection information 2004 is sent to the detection result generating portion 2500. 
[0372] The following is a description of the detection result generating portion 2500 in the present embodiment. 
[0373] Fig. 97 is diagram showing the configuration of the detection result generating portion according to the thir- 
teenth embodiment of the present invention. The detection result generating portion 2500 in the thirteenth embodiment 
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of the present invention comprises a sequence generating portion 2510 for each of the symbol positions j, a detected 
symbol generating portion 2520 and an inverse symbol transform portion 2530. 

[0374] Fig. 98 is a flow chart showing the process of the detection result generating portion according to the thirteenth 
embodiment of the present invention. 

[0375] Step 2510) The detection result generating portion 2500 inputs the symbol detection information 2004 and 
first of all, in the sequence generating portion 2510 for each of the symbol positions, divides the symbol detection 
information 2004 into each symbol position j, and generates a symbol position sequence 

corr c (0 ^ c< M, 0^ t< T) 

of length M x T for each symbol position, for each j from j =1 - J. and sends the symbol position sequence 2501 to 
the detected symbol generating portion 2520. 

[0376] Step 2520) The detected symbol generating portion 2520 inputs each symbol position sequence 2501, de- 
termines the symbol candidate c having the maximum correlation value in each sequence for each symbol position j. 
and generates a detected symbol s j (0*= j < J). This processing is repeated until all of the s j are determined. 
[0377] Step 2530) Once all of the s j have been determined, the inverse symbol transform portion 2530 transforms 
the symbol expression into an original watermark expression, and generates and outputs a detection resuit. For ex- 
ample, the inverse transform corresponds to the transform in the first embodiment having four symbols with the values 
of the four symbols (where the value of each symbol is from 0-255) being regarded as ASCII codes in processing for 
conversion into four 8-bit characters. 

[0378] The detection result indicates the watermark embedded in the detected object image 201 . 
[0379] Information detection in the present embodiment divides the detected object image 201 into blocks (of size 
Nx N of more), and detects the symbol for which the correlation is maximum in all the blocks so that it is possible to 
perform detection at a higher accuracy when compared to the previously described eleventh embodiment. Furthermore, 
the number of discrete Fourier transforms necessary for detection processing is the same as the number of blocks and 
so it is possible to perform faster processing than in the fifth embodiment. 

[Fourteenth Embodiment] 

[0380] The following is a description of processing when a block of Nx N size cannot be cut from the detected object 
image 201 in the block division portion of the watermark detection portion of a fourteenth embodiment of the present 
invention. 

[0381] Fig. 99 is a diagram describing the process of the block division portion of the watermark detection portion 
according to the fourteenth embodiment of the present invention. 

[0382] The block division portion 2100 divides the detected object image 201 from the top left into blocks of NU N 
size. When it does this, a block of an edge of the detected object image 201 may have an empty portion. In this case, 
a mean value is determined for the pixel values of the portion of the block including the detected object image, an the 
empty portion of the block is filled with that mean value and processed. Numbers from 0 - T - 1 are given to the pixel 
blocks obtained by the division. 

[0383] Information detection according to the present embodiment is improved because of the arbitrary size used 
as the necessary minimum size of the detected object image, and enables detection from a detected object image that 
is much smaller than that of the previously described thirteenth embodiment. 

[0384] Furthermore, the number of discrete Fourier transforms necessary for detection processing is the same as 
that of the number of blocks and so it is possible to have faster processing than in the sixth embodiment. 

(Fifteenth Embodiment] 

[0385] The following is a description of the position marker detection portion and the watermark detection portion of 
the fifteenth embodiment of the present invention. 

[0386] Fig. 1 00 is a diagram showing the configuration of the block generating portion of the position marker detection 
portion according to a fifteenth embodiment of the present invention. The block generating portion 3000 shown in the 
figure comprises a block division portion 3100 and a block addition portion 3200. 

[0387] Fig. 101 is a flow chart showing the process of the block generating portion of the position marker detection 
portion according to the fifteenth embodiment of the present invention. 

[0388] Step 3100) The block generating portion 3000 inputs the detected object image 201 and as shown in Fig. 102. 
the block division portion 3100 divides the detected object image 201 into T blocks of N x N pixels, from the top left. 
[0389] Step 3200) Next, the block addition portion 3200 adds all of these blocks and generates an addition block 
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3002. Expressing this as a formula gives the following. When B {] < l > : t'th block (0 1= i < N. 0^ j < N, 0^ t < T). the 
addition block A ^ (0 ^ i < N. 0^j < N) is obtained from 

5 A j = ^ZB ii (t> (0^i<N / 0^j<N) 

i o 

[0390] This addition block 3002 is output to the discrete Fourier transform portion as the pixel block 205. 
[0391] Information detection with the present embodiment divides the detected object image 201 (of a size of N x 
10 N or more) into blocks of N x N size and performs detection of the position marker and detection of the watermark 
from blocks which are the sum of all of the blocks. 

[0392] The adding of T blocks means that the watermark pattern which is a repeated pattern of size N x N is em- 
phasized T times, and that the original image pattern has a lower correlation between blocks, and is gradually cancelled 
by addition. This is to say that detection from the addition block lessens the influence of the original image and at the 
15 same time emphasizes the watermark pattern so that it is possible to perform detection at a higher accuracy than the 
eleventh embodiment. 

[0393] In addition, when compared to the eleventh embodiment, the amount of processing for detection increases 
by the amount required for generating the added block, but when compared to the amount of processing for other 
portions of detection processing, this amount of processing is so small as to be able to be ignored. In addition, when 
20 compared to the thirteenth embodiment that performs detection of one block at a time, it is possible to perform process- 
ing that is faster in proportion to the number of blocks. 

[0394] Furthermore, only one discrete Fourier transform is necessary when there is detection processing and so it 
is possible to have faster processing than any of embodiments two through ten. 

25 [Sixteenth Embodiment} 

[0395] The following is a description of a sixteenth embodiment of the present invention, for the position marker 
detection portion and the block generating portion. Those portions not described in the following are the same as those 
of the twelfth embodiment. 

30 [0396] Fig. 103 is a diagram showing the configuration of the block generating portion of the position marker detection 
portion according to the sixteenth embodiment of the present invention. The block generating portion 4000 in the figure 
comprises the block division portion 4100, and a block addition portion 4200. 

[0397] Fig. 104 is flow chart showing the process of the block generating portion of the position marker detection 
portion according to the sixteenth embodiment of the present invention. 
35 [0398] Step 4100) The block generating portion 4000 inputs the detected object image 201 and as shown in Fig. 105 
divides the detected object image 201 from the top left into T blocks of N x N pixels. When it does this, a block at an 
edge of the detected object image 201 may have an empty portion. In this case a mean value is determined for the 
pixel value of the portion of the block including the detected object image 201 and the empty portion filled with this 
mean value. 

-to [0399] Step 4200) After this, the block addition portion 4200 adds all of the blocks and generates an addition block 
4001 . Expressing this as a formula gives the following. When 

B .. tt): t'th block (0 < i < N, 0^ j < N. 0^ t < T), 

45 

the addition block A jj (0^ i < N, 0^ j < N) is obtained from 

A j j = ^ B , j (l) (0 ^ l < N , 0 :g j < N ) 

50 1 " 0 

[0400] Step 4300) This addition block is output to the discrete Fourier transform portion as the pixel block. 

[0401] The following is a description of the block generating portion in the watermark detection portion of the present 

embodiment. 

55 [0402] The watermark detection portion of the present embodiment inputs the detected object image 201 and in the 
same manner as the block generating portion 4000 of the position marker detection portion, divides the detected object 
image from the top left into T blocks of N ^ N pixels. 

[0403] After this, in the block addition portion all of these blocks are added to generate an addition block. This addition 
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block is output to the discrete Fourier transform portion as a pixel block. 

[0404] Information detection in the present embodiment described above uses an arbitrary size as the necessary; 
minimum size of the detected object image and, when compared to the previously described fifteenth embodiment, 
enables detection from a smaller detected object image. 

[0405] Furthermore, when compared to the fifteenth embodiment, the number T of divided blocks is larger and so 
the influence of the original image is lessened in detection, and the watermark pattern is more emphasized, and so it 
is possible to perform detection at a higher accuracy than with the fifteenth embodiment. 

[0406] In addition, adding the blocks lessens the influence of the original image when there is detection, and also 
emphasizes the watermark pattern, so that it is possible to perform pattern detection at a higher accuracy than with 
the twelfth embodiment. 

[0407] In addition, when compared to the twelfth embodiment, the amount of processing for detection increases by 
the portion required for generating the addition block, but when compared to the amount of processing for other portions 
of detection processing, is small enough to be ignored. Also, it is possible to perform detection at a higher accuracy 
when compared to detection in the case such as with the fourteenth embodiment where detection is performed one 
block at a time. 

[Seventeenth Embodiment] 

[0408] The following is a description of a seventeenth embodiment of the present invention, for the detected object 
sequence generating portion of the position marker detection portion. Those portions not described in the following 
are the same as the sixteenth embodiment. 

[0409] In the present embodiment, the detected object sequence generating portion of the position marker detection 
portion of each of the embodiments two through sixteen has as the final stage the generation of the detected object 
sequence as disclosed for each of the embodiments, but then performs the processing described below to make the 
mean of the detected object sequence zero, and then uses these detected object sequence that has had this processing 
implemented, in later processing. 
[0410] When 

{ q j } : detected object sequence prior to processing (0^ j < n) 

1 

ave: = 22 o q, 

n 1 0 

is determined and the average is made zero by q t : = q { - ave ( 0 i< n). 

[0411] According to the present embodiment, the mean of the detected object sequence becomes zero and each 
item has a value that is either positive or negative. This means that when the values for the correlation are added later, 
correlation values other than those having a valid peak for the position marker detection information are kept low so 
that when compared to those embodiments for which this processing is not performed, it becomes possible to perform 
detection at a better accuracy for valid peaks of the position marker detection information. 

[Eighteenth Embodiment] 

[0412] The following is a description of the detected object sequence generating portion of the watermark detection 
portion according to an eighteenth embodiment of the present invention. Those portions not described in the following 
are the same as portions of the previously described embodiments two through seventeen. 

[0413] The detected object sequence generating portion of the watermark detection portion according to the previ- 
ously described embodiments two through seventeen performs final stage processing to generate a detected object 
sequence as previously described for each of the embodiments, performs processing as described below so that the 
average for the detected object sequence is zero, and then uses this detected object sequence that has had this 
processing implemented, in later processing. 
[0414] When 

{ q s } : detected object sequence prior to processing (0 ~ i < n). 



i „ 

= q. 

n ' "° 
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is determined and the average is made zero by q { := q { -ave (0 5 i < n). 

[0415] According to the present embodiment, the average of the detected object sequence becomes zero and each 
item has a value that is either positive or negative. This means that when the values for the correlation are added later, 
correlation values other than those having a valid peak for the symbol detection information are kept low so that when 
5 compared to those embodiments for which this processing is not performed, it becomes possible to perform detection 
at a better accuracy for valid peaks of the symbol detection information. 

[Nineteenth Embodiment] 

10 [0416] The following is a description of the offset information generating portion of the position marker detection 
portion according to a nineteenth embodiment of the present invention. In the following description, those portions not 
described are the same as those of the previously described second through eighteenth embodiments. 
[0417] Fig. 106 is a flow chart showing the process of the offset information generating portion of the position marker 
detection portion according to the nineteenth embodiment of the present invention. 

15 [0418] Step 5100) The offset information generating portion inputs the position marker detection information and. 
fist of all. determines the maximum value 0 max in all of the position marker detection information. 
[0419] Step 5200) Then a threshold value |3 which has been determined beforehand is used to separate the process- 
ing as follows. There is a shift to Step 5300 when 0 max < |i and a shift to Step 5400 otherwise. 

[0420] Step 5300) A detection result indicating that the detection of the offset information has failed is output externally 
20 to the offset information detection apparatus, and the process is terminated. 

[0421] Step 5400) The offset candidate information (a. b) when the maximum value 0 m3x is taken is output as offset 
information and sent to the watermark detection portion. 

[0422] According to the nineteenth embodiment described above, detection does not continue unless the position 
marker detection information, that is, the value of the correlation between the position marker sequence and the de- 
25 tected object sequence is above the threshold value |i . This means that detection is not attempted and the output of 
an erroneous detection result is thus prevented in cases such as when the detected object image is an image that has 
no embedded information, or when detection is not possible due to severe damage to the embedded image, thereby 
increasing the reliability of the output detection result. 

30 [Twentieth Embodiment] 

[0423] The following is a- description of the detection result generating portion of the watermark detection portion 
according to a twentieth embodiment of the present invention. Those portions not described in the following are the 
same as those of the previously described 2nd through 19th embodiments. 
35 [0424] Fig. 107 is flowchart showing the process of the detection result generating portion of the watermark detection 
portion according to the twentieth embodiment of the present invention. 

[0425] Step 6100) The detection result generating portion inputs the symbol detection information and, first of all. in 

the sequence generating portion that generates the symbol position sequence for each symbol position, divides the 

symbol detection information for each symbol position j. 
-to [0426] Step 6200) The maximum value s niax U» of the sequence for each j'th (1r5 j < J) symbol position is determined 

and the processing branches as follows depending upon a predetermined threshold value y. 

[0427] Step 6300) There is a shift to Step 6400 when s max 0) < y . otherwise there is a shift to Step 6500. 

[0428] Step 6400) A detection result indicating that detection of a watermark embedded in the detected object image 

has failed is output and all processing in the detection result generating portion is terminated. 
45 [0429] Step 6500) When s max 0) > y . the symbol candidate c corresponding to the maximum value for s max ( i> is 

made the j'th detected symbol s j (1 j < J). 

[0430] Step 6600) After all s j have been determined, is transformed symbol expression is transformed into a water- 
mark expression (with, for example, the inverse transform corresponding to the transform in the first embodiment having 
four symbols (with the values of the four symbols, where the value of each symbol is from 0 -255) being regarded as 

50 ASCII code in processing of conversion into four 8-bit characters), and the detection results is generated and output. 
[0431] According to the twentieth embodiment described above, detection does not continue unless the symbol 
detection information, that is. the value of the correlation between each symbol marker sequence and the detected 
object sequence, is above the threshold value y. This means that detection is not attempted and an output of an 
erroneous detection result is thus prevented in cases such as when the detected object image is an image that has 

55 no embedded information, or when detection is not possible due to severe damage to the embedded image, thereby 
increasing the reliability of the output detection result 
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[Twenty-first Embodiment] 

[0432] Finally, the following is a description of a twenty-first embodiment of the present invention. Those portions 
not described in the following are the same as portions of the previously described first through twentieth embodiments. 
[0433] With the present embodiment, the spread sequence generator of the embedding sequence generator in the 
first embodiment, and the position marker sequence generating portion and spread sequence generatorfor the symbol 
sequence generating portion of the watermark detection portion of the twentieth embodiment use sequences (such as 
random sequences comprising either the two values of " + 1" or obtained using a k'th degree generation polynomial 
expression (where k is a sufficiently large integer) such as that disclosed in pp. 128 of "Symbol Logic" (Shokohdoh) 
by Miyagawa et al., successively generated at random using either values of +1 or -1 at respective probabilities of 1/2). 
[0434] In addition, with the present embodiment, the following is used as the calculation formula for determining the 
correlation in the symbol detection information generating portion of the symbol detection portion of the watermark 
detection portion in the twentieth embodiment. 
[0435] When there is 

{pj} : symbol sequence (0 ~f i <n) 

{qj : detected object sequence (0*-? i < n). the value of the correlation for the two sequences is 



Si (P; ,n • q , ) 
corr : = — 

/«:<>. ■ 



[0436] The distribution of the value of the correlation in the symbol detection information generating portion is now 
considered. 



, ( 0 ^ i < n ) 



is a sequence that obeys a distribution having an average which calculate each item of the sequence, to be zero 
average value (according to the eighteenth embodiment) and variance of 1/n. 

[0437] In addition, p s (0^ i < n ) has the values of +1 or -1, each with a respective probability of 1/2. and obeys a 
distribution with an average of 0 and a variance of 1. If n is sufficiently large. 



f 



( 0 S i < n ) 

q i 1 



i - o 



becomes a sequence obeying a distribution with an average of 0 and with a variance of 1 . Here, using the central limit 
theorem of probability statistics when n is sufficiently large, 



%l ( - P i • q i ) 
corr : = — — 
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obeys a normal distribution with an average of 0 and a variance of 1. Fig. 108 is a graph (n = 1024) showing the 
theoretical values N (0, 1) and the corr values according to a computer simulation of the twenty-first embodiment of 
the present invention, and from this, it can be seen that, as assumed, corr is N (0. 1). 

[0438] Once it is known that corr is N (0. 1), the threshold value y in the twentieth embodiment can be determined 

5 by probability (a scale indicating the degree to which peaks have meaning). 

[0439] For. example, a probability of 99.999% (which makes 10 - 9 the probability of a peak accidentally appearing 
above the threshold value) gives a threshold value y = 4.26489 on a normal distribution table at that time. Fig. 109 is 
a graph of symbol detection information according to a computer simulation of the twenty-first embodiment of the 
present invention. As can be seen from the figure, the symbol values that express "A". "B". C" and "D" as the result of 

10 detection of the four symbols (with each symbol having a value of from 0~ 255) all appear as significant peaks. The 
previously mentioned y is used to evaluate the degree of significance that a peak has (i.e. not an accidental value). In 
the example shown in Fig. 109, the value of each of the peaks is more than 4.26489 and so it can be judged to a 
probability of more than 99.999. that the peaks are significant. 

[0440] According to the twenty-first embodiment, the distribution of the symbol detection information can be a normal 
15 distribution with an average of 0 and variance of 1 and so it is possible to specify the certainty of symbol detection. 
This means that it is possible to determine the degree of certainty of the detection result, increase the reliability of the 
detection result and improve the convenience. 

[0441] To test the effectiveness of the proposed method, a computer simulation was run. The three test images were 
512 x 512 pixels. 8-bit gray-scale images (Lena, Sailboat, and Baboon). The parameter values used in the simulation 
20 were N=1 28. n=1023. u = 1 .4. M=256. The value of (u n , v n ) were selected from a medium frequency band specified by 

16* 7 U 2 2 +v 2 2 * 32 

25 and 32-bit ASCII text (such as "ABCD") was used. 

[0442] The following is a description of the image quality of watermarked images. 

[0443] Fig. 110 is diagram showing the PSNR when the embedding intensity (power) of the present invention was 
changed. The values for "power" shown in graph of Fig. 1 10 are relative to "power" =c, . The correspondence of PSNR 
to "power" varies from image to image due of the effect of local weighting. 
30 [0444] Parallel displacement and cutting are shown in Fig. 111 as a result of watermark detect from the watermark 
image (Lena, power = 5 . PSNR =42.107873). The offset response peak (14.761541) was detected at the offset (0.0). 
The symbol response peaks (11.180982 to 9.108589) were also detected for each symbol ('A', 'B\ 'C\ 'D' ) in the 
watermarked image, indicating a successful watermark detection. 

[0445] Next, there was an attempt at detecting watermark from a partial image cut from each image. Fig. 11 2 shows 
35 the offset detect success ratio (for when the correct offset was detected) when the size N x N of the partial image 
(having 50 start points chosen at random for each size) is changed and the symbol detect success ratio (for when all 
symbols were correctly detected and the four peak values had a minimum value larger than the threshold value of 
4.26489). It is possible with almost total certainty to detect watermark on a partial image larger than N = 256. The 
watermark is embedded in each block of 128x 128 pixels bus as shown in Fig. 11 3 (A), images that include an edge 
-10 have several large frequency component values that create a large amount of noise due to the original image as 
described before, and this is thought to have caused detect failure. Conversely, there was success with a comparatively 
flat image as shown in Fig. 113 (B). or with detect for images such as textured images. When there was detect using 
a differential with the original image, the noise due to the original image was cancelled, leading to successful detect. 
[0446] The following is a description of the JPEG compression. 
45 [0447] An attempt was made to detect watermark from an image obtained from irreversible JPEG compression of 
an image (Lena, sailboat, baboon, power =c ) having a watermark. 

[0448] Fig. 114 shows the minimum value for the symbol response peak and the offset response peak value when 
the quality parameter was changed. The lines in the graphs of that figure represent successes attained before stopping. 
If the threshold described previously is considered, the effective robustness will probably be somewhat less than that 
50 shown in Fig. 1 14. 

[0449] An attempt was made to detect watermark in a watermarked image (Lena, power = 4 ) that had undergone 
grayscale level degradation. In the case of reduction to a black and white image, the offset response peak value3 
obtained from a Floyd-Steinberg dithered image (Fig. 115 (A)) was 13.616614 and the symbol response peaks ranged 
from 9.395720 - 6.825329 and the watermark was successfully detected. In the case of a simple quantization (Fig. 
55 115 (B)). the watermark was also successful, with an offset response peak of 10.388254 and symbol response peaks 
in the range from 8.133438 to 5.680073. 

[0450] The following is a description of detect from a printed picture. 

[0451] An image having a watermark (Lena. power= 4 ) was printed using a printer and an attempt was made to 



37 



EP 1 022 678 A2 



detect the watermark from an image that was read by a scanner. The watermarked image was converted to 72 dpi 
PostScript data and printed out on a black-and-white laser printer (RICOH SP-10PS Pro/6F), 600dpi. The printed image; 
was then scanned (EPSON GT-6000) to acquire a 72 dpi in 16-bit grayscale image. The scanned image was reduced 
to 8-bit grayscale and the watermark detection was performed on that image. In this case, the watermark detection 
5 was successful, with an offset response peak value of 9.080504 and symbol response peak values ranging from 
8.139693 to 5.61 5208. The combination of printer and scanner resulted in a slight change in the aspect ratio, compen- 
sating for that aspect ratio change resulted in successful detection with an offset response peak value of 11 .701824 
and symbol response peak values ranging from 8.807638 to 6.623429. 

[0452] We attempted to detect watermarks of two watermarked image (Lena and Sailboat, both with power =^ ) in 
10 an image that was a 1:1 mixture of the two images (Fig. 1 1 6), using the respective keys of the two images. It was 
possible to detect the two different watermarks in the single mixed image, with an offset response peak value of 9.49749 
for Lena and 9.883106 for the sailboat image and symbol response peak values ranging from 8.102563 to 6.325033 
for the woman image and from 9.661891 to 7.285404 for Sailboat. 
[0453] The following is a description of the detect processing time. 
15 [0454] The offset search time using the method proposed by the present invention is N 2 and although a complete 
search is performed, but compared to a simple full search in which the block is resampled and a discrete Fourier 
transform is performed for each offset candidate, the amount of processing required for one search is small. Also, the 
processing can be speeded up by using a table of pre-calculated values for the computation of e ix in the search 
processing. Computer simulations of the invention and the simple full search described above show that the ratio of 
20 processing times is 1 : 65. The discrete Fourier transformation was performed on 128 x 128 pixel blocks using the Fast 
Fourier Transform (FFT). 

[Twenty-second Embodiment] 

25 [0455] Fig.117 is a diagram showing a configuration of a degree of local image complexity generating portion of a 
water mark embedding apparatus according to a twenty-second embodiment of the present invention. The degree of 
local image complexity generating portion 301 0 shown in the figure has an edge/texture component value image gen- 
erating portion 3110. 

[0456] Fig. 118 is a flow chart showing the process of the degree of local image complexity generating portion ac- 

30 cording to the twenty-second embodiment of the present invention. 

[0457] The degree of local image complexity generating portion 3010 inputs an input image 10 (Step 22110). gen- 
erates an edge/texture component value image generating portion 3110 generates an edge/texture component value 
image 3111 from the input image 10 (Step 221 20). and outputs the edge/texture component value image as the degree 
of local image complexity 20 (Step 22130). 

35 [0458] In more detail, the edge/texture component value image generating portion 3110 uses the following procedure 
to create the edge/texture component value image. 

[0459] Fig. 11 9 is a flow chart showing the process of the edge/texture component value image generating portion 
according to the twenty-second embodiment of the present invention. 

[0460] Step 22121) The edge/texture component value image generating portion 3110 expresses the input image 
40 10 as 

{p jj } (0 3S i < Width, Or? j < Height). 

^5 Step 22122 onward is repeated for 

0^' i < Width, 0?5 j < Height. 

50 [0461] Step 22122) The edge/texture component value image generating portion 3110 zeroes the count of the dif- 
ferential counter. 

[0462] Step 22123) If. for -1 s k £1. -1 " ' h " 1. 

I P ij *P i+k i+h I threshold value then there is shift to Step 22124, and if not. this processing is repeated until (k, 
h)=(-1.-1)-(k.n). 

55 [0463] Step 22125) The value of the differential counter after the above processing of Step 22123 and Step 22124 
has been repeated, becomes the value of the (i. j) coordinates of the edge/texture component value image. Expressing 
this as a formula gives 
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e.j = count 

where { e ^ } : edge/texture component value image (0 ? i< Width. 0i5 j< Height) 
5 [0464] According to the twenty-second embodiment of the present invention as described above, it is possible to 
g enera te a degree of local complexity for an image having a large value in the case of input image 10 having a small 
flat portion or when there is a edge or texture domain. 

[0465] In addition, as shown in Fig. 120. the use of a threshold and a differential counter enables the generation of 
a degree of local complexity for an image having a similarly large value for images having sharp edges and soft textures. 

10 

[Twenty-third Embodiment] 

[0466] The following is description of the processing for a degree of local image complexity generating portion of a 
watermark embedding apparatus of the twenty-third embodiment of the present invention. Fig. 121 is a diagram showing 
15 the configuration of the degree of local image complexity generating portion according to the twenty-third embodiment 
of the present invention. 

[0467] The degree of local image complexity generating portion 3020 shown in the figure comprises a edge/texture 
component value image generating portion 3210 of the twenty-second embodiment as shown in fig. 11 7, and in addition, 
a texture degree index generating portion 3220 and an up-sampler 3230. 
20 [0468] Fig. 122 is a flow chart showing the process of the degree of local image complexity generating portion ac- 
cording to the twenty-third embodiment of the present invention. 

[0469] The degree of local image complexity generating portion 3020 inputs the input image 10 (Step 23210) and 
an edge/texture component value image generating portion 3210 generates the edge/texture component value image 
3201 from the input image 10 (Step 23220). 
25 [0470] Next, in the texture degree index generating portion 3220. a texture degree index 3202 is created from the 
edge/texture component value image 3201 . and then the up-sampler 3230 up-samples the texture degree index 3202 
(Step 23230). makes it the same size as the input image 10. and outputs it as the degree of local image complexity 
20(Step 23240). 

[0471] The following is a description of the process of the texture degree index generating portion 3220 described 
30 above. Fig. 123 is a flow chart showing the process of the texture degree index generating portion according to the 
twenty-third embodiment of the present invention. 

[0472] Step 23231) The texture degree index generating portion 3220 divides the edge/texture component value 
image 3201 into blocks ofnxn pixels (with the edge/texture component value image, which is the result of this division, 
being Px Q blocks). 
35 [0473] The pixels in the (p. q)'th block are b jj (0 ^ i < n . 0 s? j < n ). 

[0474] Step 23232) The (p. q)'th texture degree index index pq is zeroed. 
[0475] Step 23233) lndex pq : 

index pq + b ( j with the processing repeated for 

40 (i.j) = (0.0)~(n-1.n- 1) 

and when this ends, the processing from Step 23232 onward is repeated for 

J5 (p.q) = (0.0)~(P-1.Q-1). 

[0476] In other words, making 

{b jj (p,q)} : block pixel value of the (p. q)'th edge/texture component image (0^i<n,0^j<n). 
50 means that the texture degree index index pq of the (p. q)'th block ((0^p<P.0^q<Q) can be obtained by the 
following formula. 

index pq : = if' ' b , , (pq) 

55 . - o j = o 

[0477] The following is a description of the process of the up-sampler 3230 in the present embodiment. 

[0478] Fig. 124 is a diagram describing the process of an up-sampler according to the twenty-third embodiment of 
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the present invention. The up-sampler 3230 inputs the texture degree index 3202 (P x Q pixel size) and magnifies it 
N times laterally and longitudinally so to generate and output a degree of local image complexity (of size Width *J 
Height) of an image the same size as the input image 10. 

[0479] As has been described above, according to the present embodiment, blocks of those block groups obtained 
5 by division of an edge/texture component value image into n x n pixels that include many large values, take large 
values for the texture degree index, while blocks that include many small values take small values for the texture degree 
index. 

[0480] Fig. 125 is a diagram showing an edge/texture component value image and a texture degree index according 
to the twenty-third embodiment of the present invention. As shown in the figure, a simple edge portion (the top right 
10 portion of the same figure) within the edge/texture component value image 3201 has a small number of points having 
large values included in the block and so these have correspondingly small values for the texture degree index. This 
means that when compared to the twenty-second embodiment, the present embodiment enables the generation of an 
image degree of local image complexity having higher values. 

15 [Twenty-fourth Embodiment] 

[0481] The following is description of a twenty-fourth embodiment of the present invention. 

[0482] Fig. 126 is a flow chart showing the process of a degree of local image complexity generating portion of a 
watermark embedding apparatus according to the twenty-fourth embodiment of the present invention. 

20 [0483] When the degree of local image complexity generating portion 3020 inputs the input image 10 (Step 2431 0). 
the edge/texture component value image generating portion 3210 generates the edge/texture component value image 
3201 from the input image 10 (Step 24320). Next, in the texture degree index generating portion 3220 the texture 
degree index 3202 is created from the edge/texture component value image 3201 and then the up-sampler 3230 up- 
samples the texture degree index 3202 (Step 4330). makes it the same size as the input image 10 and outputs it as 

25 the degree of local image complexity. 

[0484] Fig. 127 is flow chart showing the process of the texture degree index generating portion according to the 
twenty-fourth embodiment of the present invention. 

[0485] Step 24331- Step 24333) The texture degree index generating portion 3220 uses a value mapped by a pre- 
determined function f(x) forthe determined texture degree index (index pq ), as the new texture degree index. Expressing 
30 this as a formula gives the following. 

index pq : f (index pq ) (03E P < P. 0^ q < Q) 

35 [0486] According to the twenty-fourth embodiment, using the function to map the texture degree index 3202 obtained 
by the previously described twenty-third embodiment enables a value that is in agreement with more visual character- 
istics. 

[Twenty-fifth Embodiment] 

40 

[0487] The following is a description of a degree of local image complexity generating portion of a watermark em- 
bedding apparatus of a twenty-fifth embodiment of the present invention. 

[0488] Fig. 128 is a diagram showing the configuration of the degree of local image complexity generating portion 
according to the twenty-fifth embodiment of the present invention. The degree of local image complexity generating 
45 portion 3400 shown in the figure comprises an edge/texture component value image generating portion 3410. a texture 
degree index generating portion 3420. and a texture component value image generating portion 3430. The texture 
component value image generating portion 3430 generates and outputs a texture component value image 3403 from 
a edge/texure component image 3401 and a texture degree index 3402. 

[0489] Fig. 129 is a flow chart showing the process of the degree of local image complexity generating portion ac- 
50 cording to the twenty-fifth embodiment of the present invention. 

[0490] When the degree of local image complexity generating portion 3400 inputs the input image 10 (Step 254 10). 
the edge/texture component value image generating portion 3410 generates the edge/texture component image 3401 
from the input image 10 (Step 25420). 

[0491] Next, the texture degree index generating portion 3420 generates the texture degree index 3402 from the 
55 edge/texture component image 3401 using the method of either the twenty-third or the twenty-fourth embodiment as 
the creation method (Step 25430). Then, the texture component value image generating portion 3430 generates the 
texture component value image 3403 from the edge/texture component image 3401 and the texture degree index 3402 
(Step 25440) and outputs this as the local degree of image complexity (Step 25450). 
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[0492] The following is a description of the texture degree index generating portion 3420. 

[0493] Fig. 1 30 is flow chart showing the process of the texture component value image generating portion according 
to the twenty-fifth embodiment of the present invention. 

[0494] Step 2544 1 ) The texture component value image generating portion 3430 divides the edge/texture component 
5 3401 into blocks of n x n pixels (with the edge/texture component value image, which is the result of division, consisting 
of Px Q blocks). Step 25442 is performed for each block. 

[0495] Step 25442) The following is a description of the processing for the (p. q)'th block (0^ p < P. 0^ q < Q) of the 
texture component value image generating portion 3430. 

[0496] Taking the block pixel value (0 ^ i <n, 0 ^ j < n) of the {b - t fP^) } : (p, q)'th edge/texture component image, the 
10 texture component value image generating portion 3430 uses the following formula to determine the (p. q)'th texture 
component value block {b'jj <P- <\) } . (0^ i < n. 0 ^ j < n). 



15 

[0497] Step 25443) After this processing has been completed for all blocks, outputs the texture component value 
block 3403. which provides same position with edge/texture component value image 3401 . 

[0498] The following is a description of the image processing of the present embodiment, with reference to Fig.1 31 . 
The input image 10 shown in the figure comprises a background (of uniform pixel values), a sun (having an edge, and 
20 with a uniform interior), a tree trunk (having a light texture) and leaves (having a strong texture). In the edge/texture 
component image 3401 (with values larger for brighter portions), the handling is the same for both edges and textures. 
The portions for the tree trunk and leaves and the edge portion of the sun have largely different values for the edge/ 
texture components. This is because of the use of the differential counter. 

[0499] In the texture degree index 3402. the method of creating gives a small value for blocks that have little edge/ 
25 texture component. Because of this, the texture degree index is small for the portions of the sun that do not have an 
edge. Conversely, the portions for the tree trunk and leaves have a large edge/texture component within the block and 
so have large values for the texture degree index 3402. 

[0500] In the texture component value image 3403 (with brighter portions having larger values), the edge is weak, 
ad the texture becomes stronger which is in agreement with the objective. In addition, when compared to the output 
30 of the twenty-third embodiment, the block distortion is improved, and it is possible to generate a degree of image 
complexity for the image at a higher accuracy. 

[Twenty-sixth Embodiment] 

35 [0501] The following is a description of a watermark embedding apparatus of a twenty-sixth embodiment. 

[0502] Fig. 1 32 is a diagram showing the configuration of the watermark embedding apparatus according to the twen- 
ty-sixth embodiment of the present invention. The watermark embedding apparatus 3500 comprises a degree of local 
image complexity generating portion 3510. a watermark pattern generating portion 3520. and an image addition portion 
3530. The watermark embedding apparatus 3500 inputs an input image 51 , a watermark 52. a key 53 and an intensity 

40 parameter 54. 

[0503] Fig. 133 is a flow chart showing the process of the watermark embedding apparatus according to the twenty- 
sixth embodiment of the present invention. 

[0504] Step 25610) First of all. the degree of local image complexity generating portion 3510 generates a degree of 
local image complexity (e jj ) from the input image 51 (p^ ). The degree of local image complexity ideally indicates the 
45 amount by which object image values can be changed when visual stimulation due to changes in pixel values is less 
than a certain amount. For example, this embodiment any one of the degree of local image complexity generating 
portion previously described for the twenty-second through twenty-fifth embodiments. 

[0505] Step 26520) The watermark pattern generating portion 3520 uses the watermark 52 and the key 53 as the 
basis for generating a watermark pattern w ^ 3502. 
50 [0506] Step 26530) In the image addition portion 3530, the watermark pattern 3502 is adaptively added to the degree 
of local image complexity according to the following formula. 

P'ij := P ij + P^ers • e,, ■ w, 

55 

where. 

{p'ij} : image having embedded information (0 i < width. 0 : '" j < Height) 
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{p jj} : input image (0$ i < width. 0^ j < Height) 

{w y} : watermark pattern (0^ i < width, 0*^ j < Height) 

[0507] Step 26540) The image addition portion 3530 outputs the image p y having the watermark embedded. 

[0508] The following is a description of the watermark pattern 3502 in Step 26530. 

[0509] A complex matrix F of Nx N pixel size is prepared with a zero matrix as an initial value. N 

[0510] The k'th embedding coefficient position information L x = (x k ,y k .z k ) (generated from the key) is used to change 

F(u, v). 

[0511] When z k is a value that expresses a real number component, m k (generated from the key and the watermark) 
is added to the real number component of F(x k ,y k ). In addition, m k is add to the real number component of F (N - 
x k , N - y k ) so as to maintain the symmetry of the Fourier transform coefficient. Expressing this as a formula gives 

F(x k .y k ):=F(x k .y k ) + m k -« 

F (N - x k . N - y k ):= F(N -x k , N -y k ) + m k ■ « 
where cx is a parameter corresponding to the intensity of the basic watermark pattern. 

[0512] When z k is a value that expresses an imaginary number component, m k is added to the imaginary number 
component of F (x k . y k ). In addition, m k is subtracted from the imaginary number component of F(N -x k . N - y k ). 
Expressing this as a formula gives 

F(x k . y k ):= F(x k .y k ) + m k - « • i 

F (N - x k . N - y k ) := F(N -x k . N -y k ) - m k • u - i 
(where i is the imaginary number unit). 

[0513] This is successively performed for k = 0 ...,n-1 and the obtained coefficient matrix F(u. v) has an inverse fourier 
transform performed to give the basic watermark pattern. 

[0514] According to the twenty-sixth embodiment described above, the degree of local complexity is used to weight 
the watermark pattern which is added to the input image to obtain the image having the watermark embedded and so 
it becomes possible to suppress the visual image deterioration that accompanies embedding, and when compared to 
conventional technologies, to improve the robustness when there is deterioration of the image to the same degree. 

[Twenty-seventh Embodiment] 

[0515] The following is a description of a watermark embedding apparatus of a twenty-seventh embodiment of the 
present invention. 

[0516] Fig. 134 is a diagram showing the configuration of the watermark embedding apparatus according to the 
twenty-seventh embodiment of the present invention. The watermark embedding apparatus 3600 shown in the figure 
comprises a block division portion 3610. a degree of local image complexity generating portion 3620, an adaptive 
watermark pattern generating portion 3630. a basic watermark pattern generating portion 3640 and an image addition 
portion 3650. 

[0517] The watermark embedding apparatus 3600 inputs an input image 61 , a watermark 62, a key 63 and an intensity 
parameter 64. 

[0518] Fig. 135 is a flow chart showing the process of the watermark embedding apparatus according to the twenty- 
seventh embodiment of the present invention. 

[0519] Step 27610) The block division portion 3610 divides the input image 61 (comprising Width x Height pixels), 
into blocks 3601 of N x N pixel size. 

[0520] Step 27620) The divided blocks 3601 are used by the degree of local image complexity generating portion 
3620 to generate a degree of local image complexity 3603 of a block size. In the same manner as the previously 
described twenty-fifth embodiment, the degree of local image complexity 3603 ideally expresses the amount by which 
the symmetrical pixel values can be changed when the visual stimulation due to changes in the image pixels is lower 
than a certain level. For example, any of the degree of local image complexity generating portion described for em- 



42 



EP 1 022 678 A2 



bodiments twenty-two through twenty-five can be used. 

[0521] Step 27630) The basic watermark pattern generating portion 3640 uses the watermark 62 and the key 63 to 
generate a basic watermark pattern 3604. The basic watermark pattern 3604 is the same as that described as the 
"watermark pattern" in the twenty-sixth embodiment. Specifically, this is expressed by the following formula. 
5 [0522] A complex matrix F of N x N size is prepared with a zero matrix as an initial value. 

[0523] The k'th embedding coefficient position information L k =(x k ,y k ,z k ) (generated from the key) is used to 
change F (u. v). 

[0524] When z k is a value that expresses a real number component, m k (generated from the key and the watermark) 
is added to the real number component of F (x k ,y k ). In addition m k is add to the real number component of F(N -x k , 
w N -y k ) so as to maintain the symmetry of the Fourier transform coefficient. Expressing this as a formula gives 

F(x k .y k ): = F(x k .y k ) + m k -u 

15 F(N -x k .N -y k ): = F(N -x k .N -y k ) + m k • a 

where, a is a parameter given to the intensity of the basic watermark pattern. 

[0525] When z k is a value that expresses an imaginary number component, m k is added to the imaginary number 
20 component of F(x k .y k ). In addition, m k is subtracted from the imaginary number component of F (N-x k ,N -y k ). 
Expressing this as a formula gives 

F(x k .y k ) : = F(x k ,y k ) + m k • a • i 

25 

F(N -x k .N -y k ): = F(N -x k ,N -y k ) - m k • a • i 

(where i is the imaginary number unit). 
30 [0526] This is successively performed for k = 0 ...,n-1 and the obtained coefficient matrix F(u, v) has an inverse 
Fourier transform performed to give the basic watermark pattern. 

[0527] Step 27630) Furthermore, the adaptive watermark pattern generating portion 3630 generates the adaptive 
watermark pattern 3602. 

[0528] The method of determining the adaptive watermark pattern 3602 is expressed by the following formula. 

35 

M ij-( e ij- e min H e max - e ij) ' b ij 

p' := Pjj + power • l - * } - 

max min 

40 where 

{ p*j|. } : block having embedded information (0^ ; i < N, 0^ j < N ) 
{ p jj; } : block (0? i < N. Qr~ j < N ) 

{e jj. } : degree of local image complexity (0 5 i < N, 0^ j < N ) 
^5 {a .. y } : adaptive watermark pattern (0 <= i < N, 0 j < N ) 

{b ij: } : basic watermark pattern (0^i < N, O^" j < N ) 
power: intensity parameter 

e max : maximum value of the area according to the formula defining the degree of local image complexity 
e mjn : minimum value of the area according to the formula defining the degree of local image complexity 
50 |3 : adaptive watermark pattern emphasis ratio 

[0529] Step 27660) After the blocks 3605 having the embedded watermark have been generated for all blocks 360, 
the blocks 3605 having the embedded watermark are arranged at the original block positions and an image 65 having 
the embedded watermark is obtained. 
55 [0530] The following is a description of the adaptive watermark pattern generating portion 3630 in the present em- 
bodiment. 

[0531] The adaptive watermark pattern generating portion 3630 emphasizes the orthogonal transform coefficient 
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corresponding to the basic watermark pattern 3604, in accordance with the value of the amplitude of the orthogonal 
transform coefficient of the block that is currently being referred to. 

[0532] Fig. 136 is a flow chart showing the process of the adaptive watermark pattern generating portion according 
to the twenty-seventh embodiment of the present invention. 

[0533] Step 27461) The blocks that have been divided by the block division portion 3610 undergo a discrete Fourier 
transform to obtain a block coefficient matrix G (u, v). 

[0534] Step 27642) The basic watermark pattern undergoes a discrete Fourier transform to generate a complex 
watermark coefficient matrix F (u. v) (0 ^ u < N, 0^ v < N). 

[0535] Step 27643) When | G(u, v) | < a for (u.v) = (0. 0) - (N - 1, N- 1), there is a shift to Step 27644, and if not. 
there is a shift to Step 27645. 

[0536] Step 27644) When | G(u, v) | < a. y ;= a and there is shift to Step 27646. 

[0537] Step 27645) When | G(u. v) | u. y := | G(u, v) | . Moreover, the u in Step 27644 and Step 27645 is threshold 
value that is determined beforehand. 
[0538] Step 27646) F(u .v):= F(u ,v) ■ y . 

[0539] Step 27647) F'(u .v) undergoes a discrete Fourier transform and is output as the adaptive watermark pattern 
3602. 

[0540] As has been described above, according to the present embodiment and as shown in Fig. 137. it is possible 
to perform image embedding using a watermark pattern that accurately reflects a local design in the input image. This 
is to say that there is no correlation between the design of the original block 3601 (diagonal lines of the left-front fan- 
shaped portion) and the basic watermark pattern 3604. but the adaptive watermark pattern 3602 accurately reflects 
the design of the block 3601 . These degrees of local image complexity are used to give a weighting and adding enables 
the embedding of watermark in a shape that accurately reflects the original design of the block 3601 and that has a 
strong power. 

[0541] In addition, the process and configuration of the embodiment described above is configured as a program 
that can easily realize the present invention by storage in a device connected to a computer used as an information 
embedding apparatus or a watermark embedding apparatus storage in a portable storage medium such as a floppy 
disk or CD-ROM or the like and installed to implement the present invention. 

[Twenty-eighth Embodiment] 

[0542] With the present embodiment, it is possible to realize the watermark embedding apparatus described in the 
first through twenty-seventh embodiments, by an integrated circuit as shown in Fig. 138. The integrated circuit shown 
in Fig. 138 comprises a memory portion 1. a microprocessor portion 2, and an interface portion 3 having an external 
interface. Moreover, this figure only shows the main portion but also includes other circuits. The program stored in the 
memory portion 1 is run by the microprocessor portion 2. Various other configurations are also possible for the integrated 
circuit. 

[0543] In addition, it is also possible to perform the watermark processing of the present invention by incorporating 
these integrated circuits into various devices such as a video camera and a playback device, for example. 
[0544] As has been described above, according to the present invention, it is possible to have the following effects 
and applications. 

[0545] For the authors, the purpose is to protect copyright over the content of the information and so the watermark 
must have robustness with respect to editing by various types of users, while for the users, it must be possible to use 
the content of the information while being unaware of the watermark and so it must not be possible to sense any 
deterioration of images that have undergone watermark processing. 

[0546] According to the present invention, improving the image quality and the robustness over that of the conven- 
tional technology enables a copyright protection system to function more effectively, and enable authors to securely 
supply an information content, thereby promoting the flow of information over networks. 

[0547] In a content distribution system, the present invention gives a content ID so as to uniquely identify the content, 
and this content ID is then embedded in the content to link the information of the author of the content with user 
conditions and the like, so that use in a content management system encourages the correct use of the content, and 
on the side of those holding rights, guarantees that one hold rights to the content. 

[0548] In addition, the present invention embeds user information when the content is distributed so that is possible 
to suppress illegal copying. 

[0549] Futhermore. embedding copy management signals used by DVD and the like can realize more rigid copy 
protection than at present. 

[0550] Moreover, the present invention is not limited to the embodiments described above, as various modifications 
and applications are possible within the scope of the claims. 
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ms 

A watermark embedding method that embeds a watermark in a digital image so that watermark is imperceptible 
visually digital data, the method comprising: 

a step for changing independently a real number component and an imaginary number component of each of 
coefficient values of a complex watermark coefficient matrix using a key and the watermark to be embedded 
in said digital image; 

a step for generating a watermark pattern by performing a discrete Fourier transform on said changed water- 
mark coefficient matrix; and 

a step for generating an embedded image by adding like tiling said watermark pattern to said digital image. 

The watermark embedding method as claimed in claim 1. further comprising: 

a step for generating from said key embedding object component position information which is a sequence 
having a watermark embedding length; 

a step for spreading position marker information and said watermark into an embedding sequence using said 
key; 

a step for changing a component value of the complex watermark coefficient matrix, which has a zero matrix 
s an initial value, using said embedding object component position information and said embedding sequence; 
a step for emphasising said watermark pattern by using an intensity parameter; and 

a step for generating said embedded image obtained by adding like tiling, said emphasized watermark pattern 
to said digital image. 

The watermark embedding method as claimed in claim 2. 

wherein said step for generating said embedding object component position information, comprises: 
a step for generating a random number sequence that has said key as an initial value; and 
a step for generating said embedding object component position information from said random number se- 
quence. 

The watermark embedding method as claimed in claim 2. 

wherein said step for spreading said position marker information and said watermark into said embedding 
sequence using said key, comprises: 

a step for gene rating a first spread sequence that has said key as an initial value and indicates position marker 
information; 

a step for magnifying said first spread sequence into a sequence that expresses position marker information, 
magnifying said first spread sequence a required number of times and storing said first spread sequence in 
memory means; 

a step for converting said watermark into a symbol expression and obtaining the total number of symbols and 
the value of each symbol; 

a stepforgenerating a second spread sequence thathas as its initial value a sum of said key and said symbol 
value; 

a step for adding said second spread sequence to each item of said magnified first spread sequence in stored 
memory means; and 

a step for determining an average value of each stored value in said memory means, subtracting said average 
value from each item in said memory means, and outputting the result of said subtraction as said embedding 
sequence. 

The watermark embedding method as claimed in claim 4, 

wherein said first spread sequence has values of either +1 or -1 . 

The watermark embedding method as claimed in claim 2. 

wherein said step for spreading said position marker information and said watermark into said embedding 
sequence, comprises: 

a step for generating a first spread sequence using said key as an initial value; 
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a step for multiplying said first spread sequence by a predetermined parameter, and storing the resulting said 

first spread sequence in said memory means: 

a step for converting said watermark into a symbol expression; 

a step for adding a second spread sequence corresponding to a symbol of said symbol expression to each 
5 item of said first spread sequence in said memory means: and 

a step for taking the results of subtracting a value from said each item in said memory means as said embedding 
sequence. 

7. The watermark embedding method as claimed in claim 6, 

io wherein said first spread sequence has values of either + 1 or -1. 

8. A watermark detection method for detecting an embedded watermark in a detected object image, which watermark 
is imperceptible visually, the method comprising: 

15 a step for cutting a pixel block from an arbitrary position of said detected object image; 

a step for obtaining a coefficient matrix by performing a discrete Fourier transform on said block; 

a step for generating detected object component position information specified by a key; 

a step for multiplying a phase difference of a coefficient due to an amount of parallel displacement, with each 

item of said detected object component position information, and generating a position marker sequence: 
20 a step for extracting offset information which is the amount of parallel displacement when a start point of the 

embedded watermark is in agreement with a start point of the pixel block cut from the detected object image; 

and 

a step for detecting said embedded watermark from said pixel block cut from the detected object image on 
the basis of said offset information. 

25 

9. The watermark detection method as claimed in claim 8. 

wherein said step for generating said detected object component position information from said key. compris- 
ing: 

30 a step for generating a random number sequence that has said key as an initial value; and 

a step for generating said detected object component position information from said random number sequence. 

10. The watermark detection method as claimed in claim 8. 

3 5 wherein said step for generating said position marker sequence, comprises: 

a step for generating a O'th spread sequence that has said key as an initial value; and 
a step for outputting said spread sequence as said position marker sequence. 

11. The watermark detection method as claimed in claim 8. 

40 

wherein said step for extracting said offset information comprises: 
a step for generating offset candidate information; 

a step for cutting a pixel block from said detected object image from a position of said offset candidate infor- 
mation; 

45 a step for performing a discrete Fourier transform on said pixel block and generating a detected object coef- 

ficient matrix; 

a step for generating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix; 

a step for grouping correlation values for said position marker sequence and said detected object sequence 
50 along with said offset candidate information and generating said position marker detection information; and 

a step for extracting offset information for which the value of the correlation between said position marker 
sequence and said detected object sequence is maximum. 

12. The watermark detection method as claimed in claim 8. 

55 

wherein said step for detecting said embedded watermark comprising: 

a step for cutting pixel block of NX N pixels from a position of said detected object image, which position has 
undergone parallel displacement by an anvumt said offset candidate information; 
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a step for performing a discrete Fourier transform on said pixel block and generating a detected object coef- 
ficient matrix; 

a step for generating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix; 
5 a step for generating symbordetection information from said detected object sequence and said key; and 

a step for detecting, as a watermark, a detection result from said each detected symbol of said symbol detection 
information. 

13. The watermark detection method as claimed in claim 12, 

10 

wherein said step for detecting, as said watermark, said detection result from said symbol detection information 
comprises: 

a step for generating a sequence for each symbol position of said symbol detecting information; 
a step for selecting, as the detected symbol, a symbol candidate having a maximum value in the sequence 
'5 for said each symbol position; and 

a step for performing inverse symbol transform of said detection symbol and obtaining results of said detect. 

14. The watermark detection method as claimed in claim 8. 

20 wherein said step for detecting said embedded watermark, comprising: 

a step for outputting a pixel block cut from said detected object image by cyclic shift of said cut pixel block, 
according to said offset information. 

15. The watermark detection method as claimed in claim 8. 

25 

wherein said step for detecting said embedded watermark, comprising: 

a step for cutting pixel block of Nx N pixels from said detected object image when a size of said detected 
object image is equal to or greater than N^ N pixels; 

a step for. when the size of said detected object image is smaller than Nx N pixels, determining an average 
30 pixel value for a portion of said detected object image included when an N x N size pixel block is cut. filling 

a remaining empty portion of said Nx N size pixel block with said average pixel value, and generating a first 
pixel block; and 

a step for performing cyclic shift of said fist pixel block and outputting said cyclic shifted first pixel block as a 
pixel block. 

35 

16. The watermark detection method as claimed in claim 8, 

wherein said step for detecting said embedded watermark, comprising: 

a step for dividing said detected object image into a pixel block from a position corresponding to said offset 
to information; 

a step for performing a discrete Fourier transform on said divided pixel block and generating a detected object 
coefficient matrix; 

a step for generating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix; 
^ 5 a step for generating symbol detection information from said detected object sequence and said key; and 

a step for outputting a detection result corresponding to said symbol detection information. 

17. The watermark detection method as claimed in claim 8, 

50 wherein said step for detecting said embedded watermark, comprising: 

a step for dividing said detected object image into pixel blocks and performing cyclic shift said pixel blocks 
according to said offset information; 

a step for performing a discrete Fourier transform on said pixel block that has undergone said cyclic shift, and 
generating a detected object coefficient matrix, and 
55 a step for generating a detected object sequence from said detected object component position information 

and said detection object coefficient matrix. 

a step for generating symbol detection information from said detected object sequence-and said key; 

a step forgenerating each detected symboi from said symbol detection information, and detecting a watermark 
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from said each detected symbol. 

18. The watermark detection method as claimed in claim 8, 

wherein said step for detecting said embedded watermark, comprising: 

a step for dividing said detected object image into pixel blocks and performing cyclic shift of said pixel blocks 
according to the offset information wherein, pixel blocks around the edges of the detected object image contain 
empty portions, the empty portions are filled with an average pixel value; 

a step for performing a discrete Fourier transform on said pixel block and generating a detected object coef- 
ficient matrix; 

a step for generating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix; 

a step for generating symbol detection information from said detected object sequence and said key; and 
a step for generating each detected symbol from said symbol detection information, and detecting a watermark 
from said detected symbol. 

19. The watermark detection method as claimed in claim 8. 

wherein said step for generating said position marker sequence, comprising: 

a step for dividing said detected object image into blocks using said using offset information, and 

a step for outputting an additional block, which is the sum of corresponding pixel values of said pixel blocks, 

as a pixel block. 

20. The watermark detection method as claimed in claim 8. 

wherein said step for generating said position marker sequence, comprising: 
a step for dividing said detected object image into blocks; and 

a step for generating an addition block by adding corresponding pixel values of said divided blocks, using an 
offset to perform cyclic shift of said additional block, and generating said cyclic shifted additional block as a 
pixel block. 

21. The watermark detection method as claimed in claim 8. 

wherein said step for generating said position marker sequence, comprising: 

a step for dividing said detected object image into block and, when a block around the edge of said detected 
object image contains an empty portion, determining an average value of pixel values of the portion of the 
block including detected object image, and filling said empty portion with said average value; 
a step for generating an additional block by adding corresponding to pixel values of said divided blocks; and 
a step for using an offset to perform cyclic shift of said additional block and outputting said cyclic shifted 
additional block as a pixel block. 

22. The watermark detection method as claimed in claim 11, 

wherein said step for generating said position marker sequence, comprising; 

a step for determining an average value of said detected object sequence prior to generating said detected 
object sequence. 

23. The watermark detection method as claimed in claim 12. 

wherein said step for detecting said watermark, comprising: 

a step for determining an average value of said detected object sequence prior to generating said detected 
object sequence. 

24. The watermark detection method as claimed in claim 8. 

wherein said step for generating said position marker sequence, and extracting said offset information, com- 
prising: 

a step fordetermining a maximum value of said position markerdetection information, and when said maximum 
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value is smaller than a required threshold value, outputting offset detection failure information, and said re- 
quired threshold value, outputting said offset information corresponding to said maximum value. 



25. The watermark detection method as claimed in claim 8, 

5 

wherein said step for detecting said watermark, comprising: 

a step for dividing symbol detection information into that for each symbol position, and generating a sequence 
for each symbol position; 

a step for determining a maximum value of said sequence for said each symbol position, and when said 
w maximum value is smaller than a required threshold value, outputting watermark detection failure information. 

and when said maximum value is equal to or greater than said required threshold value, detecting a symbol 
corresponding to said maximum value; and 

a step for converting from said detected symbol into a watermark expression. 



'5 26. The watermark detection method as claimed in claim 25, 

wherein said required threshold value is determined on the basis of a value of normal distribution function 
having an average of 0 and a variance of 1 . 

27. A watermark detection method that detects an embedded watermark so that information of contents is impercep- 
20 tible visually, from a detected object image embedded said watermark, comprising: 

a step for generating object component position information from key. 
a step for generating a position marker sequence from said key. 

a step for detecting offset information that expresses the degree to which a start point of an embedded wa- 
25 termark pattern is displaced from a start point of a pixel block cut from said detected object image; and 

a step for detecting watermark embedded in said pixel block cut from said detected object image using said 
offset information. 



28. The watermark detection method as claimed in claim 27. wherein said step for generating object component po- 
30 sition information, comprising: 

a step for generating a random number sequence taking said key as an initial value, and 

a step for generating detected object component position information having the same length as the length of 

an embedded embedding sequence using said random number sequence. 

35 

29. The watermark detection method as claimed in claim 27, wherein said step for generating position marker se- 
quence, comprising: 

a step for generating a spread sequence having a O'th length and said key as an initial value, and outputting 
said spread sequence as a position marker sequence. 

40 

30. The watermark detection method as claimed in claim 27. wherein said step for generating position marker se- 
quence, comprising: 

a step for cutting a pixel block of a size of Nx N pixels from said detected object image using said detected 
45 object component position information and said position marker sequence; 

a step for performing a discrete Fourier transform on said pixel block, and generating detection object coeffi- 
cient matrix; 

a step for generating a detected object sequence from said detected object coefficient matrix and said detected 
object component position information; and 
50 a step for grouping correlation values for said position marker sequence and said detected object sequence 

and generating said position marker detection information. 

31. The watermark detection method as claimed in claim 27. wherein said step for generating position marker sequence 
comprises; 

55 

a step for dividing said detected object image into blocks of fsU N size, and 

a step for taking an added block that is the sum of pixel values of all blocks, as a pixel block. 
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32. The watermark detection method as claimed in claim 27. wherein s.^.d step for detecting watermark, comprising: 

a step for cutting a pixel block from said detected object image using said detected object image, said detection 
object component position information, said offset information and said key; 
5 a step for performing a discrete Fourier transform on said pixel block, and generating a detected object coef- 

ficient matrix. 

a step for generating a detected object sequence from said offset information said detected object coefficient 
matrix and said detected object component position information; 

a step for generating symbol detection information from a correlation value between said detected object 
sequence and a sequence generated from said key and symbol candidate information; 

a step for using each symbol position of said symbol detection information as the basis for detecting a symbol 
when the value of the correlation is maximum; and 

a step for outputting a result of conversion from said detected symbol into a watermark format. 

'5 33. The watermark detection method as claimed in claim 27. wherein said step for generating said position marker 
sequence, comprising: 

when a pixel block of a size of N^ N pixels has been cut from said detected object image, in a case said 
pixel block has an empty portion, determining an average of pixel values of a portion of said pixel of said pixel 
block including said detected object image, and filling said empty portion with said average value. 

20 

34. The watermark detection method as claimed in claim 32, wherein said step for detecting said watermark, compris- 
ing: 

a step for dividing a pixel block from said detected object image; 
25 a step for performing a discrete Fourier transform on said pixel block and generating a detected object coef- 

ficient matrix; 

a step for generating a detected object sequence from said offset information, said detected object coefficient 
matrix and said detected object component position information; 

a step for generating a detected symbol from said detected object sequence and said key, and 
30 a step for detecting a watermark from said detected symbol. 

35. The watermark detection method as claimed in claim 34. wherein said step for detecting said watermark, compris- 
ing: 

when a pixel block of a size of Nx N pixels has been cut from said detected object image, in a case said 
35 pixel block has an empty portion, determining an average of pixel values of a portion of said pixel of said pixel 

block including said detected object image, and filling said empty portion with said average value. 

36. The watermark detection method as claimed in claim 27, wherein said step for detecting said position marker 
sequence and said step for detecting said watermark, comprising: 

40 

a step for dividing said detected object image into blocks of Nx N pixel size; and 

a step for outputting an additional block, which is the sum of respective pixel values for all blocks, as a pixel 
block. 

45 37. The watermark detection method as claimed in claim 27. wherein said step for detecting said watermark, compris- 
ing: 

when a pixel block of a size of Nx N pixels has been cut from said detected object image, in a case said 
pixel block has an empty portion, determining an average of pixel values of a portion of said pixel of said pixel 
block including said detected object image", and filling said empty portion with said average value. 

50 

38. The watermark detection method as claimed in claim 31. wherein said step for detecting said position marker 
sequence, comprising: 

a step for generating said detected object sequence, and calculating an average from item of said detected 
object sequence so as to the average value to be 0. 

55 

39. The watermark detection method as claimed in claim 32. wherein said step for detecting said watermark, compris- 
ing: 

a step for generating said detected object sequence, and calculating an average from item of said detected 
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10 



object sequence so as to the average value to be 0. 

40. The watermark detection method as claimed in claim 34. wherein said step for detecting said watermark, compris- 
ing: 

a step for generating said detected object sequence, and calculating an average from item of said detected 
object sequence so as to the average value to be 0. 

41. The watermark detection method as claimed in claim 27, wherein said step for detecting said offset information, 
comprising: 

a step for determining a maximum value of said position marker detection information: and 
a step for outputting offset detection failure information when a maximum of said position marker detection 
information is smaller than a required threshold value, and outputting said offset information when said max- 
imum value is equal to or larger than said required threshold value. 

42. The watermark detection method as claimed in claim 32. wherein said step for detecting said watermark, compris- 
ing: 

a step for dividing said symbol detection information for each symbol position; 
20 a step for determining a maximum value of a sequence for each symbol position; and 

a step for outputting watermark detection failure information when said maximum value is smaller than a re- 
quired threshold value, and outputting a symbol candidate when said maximum value is equal to or larger than 
said required threshold value. 



15 



25 43. The watermark detection method as claimed in claim 42, wherein said required threshold value is determined 
according to a value of a normal distribution function and confidence value having a average of 0 and a variance of 1 . 

44. A watermark embedding apparatus that embeds watermark into a digital image so that is the watermark is imper- 
ceptible, which apparatus includes: 

30 

means for independently changing a real number component and an imaginary number component of each 
coefficient value of a complex watermark coefficient matrix by using a key and the watermark to be embedded 
in said digital image; 

means for performing a discrete Fourier transform on the watermark sequence matrix that has been changed, 
35 and generating a watermark pattern; and 

means for adding like tiling said watermark pattern to said digital image, and generating an embedded image. 

45. The watermark embedding apparatus as claimed in claim 44, further comprising: 

-io embedding object component specification means for generating from said key embedding object component 

position information which is the component of length, width and coordinates of the sequence; 
embedding sequence generation means for using said key to disperse position marker information and said 
watermark into an embedding sequence; 

component value change means for using said embedding object component position information and said 
^5 embedding sequence to change the watermark coefficient matrix which has a zero matrix as an initial value: 

discrete Fourier transform means for performing discrete Fourier transform on said changed watermark coef- 
ficient matrix and generating said watermark pattern; and 

watermark pattern addition means for using an intensity parameter to emphasize said watermark pattern, and 
generating said embedded image obtained by adding like tiling said emphasized watermark pattern to the 
50 digital image. 

46. The watermark embedding apparatus as claimed in claim 44. wherein said embedding object component specifi- 
cation means, further comprises: 

55 random number generation means for generating a random number sequence that has said key as an initial 

value; and 

means for using said random number sequence to generate said embedding object component position in- 
formation. 
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47. The watermark embedding apparatus as claimed in claim 45. wherein said embedding sequence generation 
means, further comprises: 

means for generating a first spread sequence having said key as an initial value, and indicating position mark 
information, magnifying said first spread sequence a required number of times and storing said magnified first 
spread sequence, converting said watermark into a symbol expression, obtaining a total number of symbols and 
a value for each symbol, generating a second spread sequence that takes as its initial value a sum of said key 
and said symbol value adding said second spread sequence to each item of said stored first spread sequence, 
determining an average value of stored values, subtracting stored value, and outputting the result of the subtraction 
the average value from each as the embedding sequence. 

48. The watermark embedding apparatus as claimed in claim 45. wherein said embedding sequence generation means 
uses either +1 or-1 as value of said first spread sequence and said second spread sequence. 

49. The watermark embedding apparatus as claimed in claim 45. wherein said embedding sequence generation 
means, comprises: 

means for generating a first spread sequence taking said key as an initial value, multiplying said first spread 
sequence by a predetermined parameter and holding the resulting first spread sequence in a storage means, 
converting said watermark into a symbol expression, adding a second spread sequence, corresponding to a symbol 
of said symbol expression, to each item in said storage means, and taking the results of subtracting an average 
value from each item in said storage means, as said embedding sequence. 

50. The watermark embedding apparatus as claimed in claim 49. wherein said embedding sequence generation means 
uses either +1 or -1 as value of said first spread sequence. 

51. A watermark detection apparatus for detecting an embedded watermark in a detected object image, which water- 
mark cannot be sensed visually, the apparatus comprising: 

detected object component specification means for generating detected object component position information 
from a key; 

position marker sequence generation means for generating a position marker sequence from the key; 
position marker detection means for detecting said position marker sequence, and extracting a offset infor- 
mation when a start point of the embedded watermark is in agreement with a start point of a pixel block cut 
from a detected object image; and 

watermark detection means for detecting said embedded watermark from said pixel block cut from said de- 
tected object image on the basis of said offset information. 

52. The watermark detection apparatus as claimed in claim 51 , wherein said detected object component specification 
means, comprises: 

means for generating a random number sequence that has said key as an initial value; and 
means for generating said detected object component position information from said random number se- 
quence. 

53. The watermark detection apparatus as claimed in claim 51, wherein said position marker sequence generation 
means, comprises: 

a means for generating a O'th spread sequence taking said key as an initial value, and outputting said spread 
sequence as said position marker sequence. 

54. The watermark detection apparatus as claimed in claim 51. wherein said position marker detection means, com- 
prises: 

means for generating offset candidate information, and cutting a pixel block from a position of said detected 
object image, which position is determined by said offset candidate information; 

means for performing a discrete Fourier transform on said pixel block and generating a detected object coef- 
ficient matrix; 

means for generating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix. 

means for grouping said offset candidate information and a correlation value for said position marker sequence 
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and said detected object sequence and generating position marker detection information; and 

means for extracting, as said offset information offset candidate information when the correlation value for 

said position marker sequence and said detected object sequence is maximum. 

5 55. The watermark detection apparatus as claimed in claim 51 , wherein said watermark detection means, comprises: 

means for cutting a pixel block of N x N pixels from a position of said detected object image, which position 
has undergone parallel displacement by the amount of said offset candidate information; 
means for performing a discrete Fourier transform on said pixel block and generating a detected object coef- 
10 ficient matrix; 

means for generating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix; 

means for generating symbol detection information from said detected object sequence and said key; 
means for generating each detected symbol from said symbol detection information; and 
15 means for outputting, as a watermark, a detection result from said each detected symbol. 

56. The watermark detection apparatus as claimed in claim 55, wherein said watermark detection means, further 
comprises: 



20 means for generating a sequence for each symbol position of said symbol detection information; and 

means for selecting, as the detected symbol, a symbol candidate having a maximum value in the sequence 
for said each symbol position, performing on inverse symbol transform on said detected symbol, and obtaining 
said detection result. 



25 57. The watermark detection apparatus as claimed in claim 51 . wherein said watermark detection means, comprises: 
means for outputting a pixel block cut. from said detected object image by cyclic shift of said cut pixel block, 
according to said offset information. 



58. The watermark detection apparatus as claimed in claim 51 . wherein said watermark detection means, comprises: 

30 

means for cutting pixel blocks of NU N pixels from said detected object image when a size of said detected 
object image is equal to or greater than N.n N pixels; 

means for. when the size of said detected object image is smaller than Nx N pixels, determining an average 
pixel value for a portion of said detected object image included when an Nx N size pixel blocks, filling a 
35 remaining empty portion of said Nx N size pixel block with said average pixel value, and generating a first 

pixel block; and 

means for performing cyclic shift of said first pixel block and outputting said cyclic shifted first pixel block as 
a pixel block. 

-io 59. The watermark detection apparatus as claimed in claim 51 . wherein said watermark detection means, comprises: 

means for dividing said detected object image into a pixel block from a position corresponding to said offset 
information; 

means for performing a discrete Fourier transform on said a divided pixel block and generating a detected 
object coefficient matrix; 

means for generating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix; 

means for generating symbol detection information from said detected object sequence and said key; and 
means for outputting a detection result corresponding to said symbol detection information. 

The watermark detection apparatus as claimed in claim 51 , wherein said watermark detection means, comprises: 

means for dividing said detected object image into pixel blocks and performing cyclic-shift of said pixel blocks, 
according to said offset information; 
55 means for performing a discrete Fourier transform on said pixel block that has undergone said cyclic-shift, 

and generating a detected object coefficient matrix; 

means for generating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix: 
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means for generating symbol detection information from said detected object sequence and said key; 
means for generating each detected symbol from said symbol detection information; and 
means for detecting a watermark from said each detected symbol. 

61 . The watermark detection apparatus as claimed in claim 5 1 . wherein said watermark detection means, comprises: 

means for dividing said detected object image into pixel blocks, and performing cyclic shift of said pixel blocks, 
according to the offset information, wherein when pixel blocks around the edges of the detected object image 
contain empty portions, the empty portions are filled with an average pixel value; 

means for performing a discrete Fourier transform on said pixel block and generating a detected object coef- 
ficient matrix; 

means for generating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix; 

means for generating symbol detection information from said detected object sequence and said key; and 
means for generating each detected symbol from said symbol detection information. 

62. The watermark detection apparatus as claimed in claim 51. wherein said position marker sequence generation 
means, comprises: 

means for using an offset to divide said detected object image into pixel blocks; and 

means for outputting an additional block, which is the sum of corresponding pixel values of said pixel blocks, 
as a pixel block. 

63. The watermark detection apparatus as claimed in claim 51. wherein said position marker sequence generation 
means, comprises: 

means for dividing said detected object image into blocks, and 

means for generating an additional block by adding corresponding pixel values of said divided blocks, using 
an offset to perform cyclic shift of said additional block, and generating said cyclic shifted additional block as 
a pixel block. 

64. The watermark detection apparatus as claimed in claim 62, wherein said position marker sequence generation 
means, comprises: 

means for dividing said detected object image into blocks and. when a block around the edge of said detected 
object image contains an empty portion, determining an average value of pixel values of the portion of the 
block including detected object image, and filling said empty portion with said average value; 
means for generating an additional block by adding corresponding pixel values of said divided blocks; and 
means for using an offset to perform cyclic shift of said additional block and outputting said cyclic shifted 
additional block as a pixel block. 

65. The watermark detection apparatus as claimed in claim 54. wherein said position marker sequence generation 
means, further comprises: 

means forchanging said detected object sequence so that an average value of said detected object sequence 
is zero. 

66. The watermark detection apparatus as claimed in claim 55, wherein said watermark detection means, further 
comprises: 

means for changing said detected object sequence so that an average value of said detected object sequence 
is zero. 

67. The watermark detection apparatus as claimed in claim 54, wherein said position marker detection means, com- 
prises: 

means for determining a maximum value of said position marker detection information, and when said max- 
imum value is smaller than a required threshold value, outputting offset-detection failure information, and when 
said maximum value is equal to or greater than said required threshold value, outputting said offset information 
corresponding to said maximum value. 
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68. The watermark detection apparatus as claimed in claim 51 , wherein said watermark detection means, comprises: 

means for dividing symbol detection information for each symbol position, and generating a sequence for each 
symbol position; 

5 means for determining a maximum value of said sequence for said each symbol positions, and when said 

maximum value is smaller than a required threshold value, outputting watermark-detection failure information, 
and when said maximum value is equal to or greater than said required threshold value, detecting a symbol 
corresponding to said maximum value: and 

means for converting from said detected symbol into a watermark expression. 

10 

69. The watermark detection apparatus as claimed in claim 68. wherein said required threshold value is determined 
on the basis of a value of a normal distribution function having an average of 0 and a variance of 1 . 



70. A watermark detection apparatus for detecting an embedded watermark in a detected object image . which water- 
15 mark cannot be sensed visually, the apparatus comprising: 

detected object component specification means for generating detected object component position information 
from key: 

position marker sequence generation means for generating a position marker sequence from said key: 
20 position marker detection means for using position marker detection information to generation offset informa- 

tion that expresses the degree to which a start point an embedded watermark pattern is displaced from a start 
point of a pixel block cut from said detected object image; and 

watermark detection means for using said offset information to detect a watermark embedded in said pixel 
block. 

25 

71. The watermark detection apparatus as claimed in claim 70. wherein said detected object component specification 
means, comprises: 

means for generating a random number sequence that has said key as an initial value; and 
30 means for using said random number sequence as an basis for generating said detected object component 

position information having the same length as the length of an embedding sequence. 

72. The watermark detection apparatus as claimed in claim 70, wherein said position marker sequence generation 
means, comprises: 

35 means for generating a O'th spread sequence having said key as the intial value, and outputting spread 

sequence as a position marker sequence. 

73. The watermark detection apparatus as claimed in claim 70, wherein said position marker detection means, com- 
prises: 

AO 

means for cutting a pixel block of a size N ^ N pixels from said detected object image using said detected 
object component position information and said position marker sequence: 

means for performing a discrete Fourier transform on said pixel block and generating a detected object coef- 
ficient matrix; 

45 means for generating a detected object sequence from said offset information, said detected object coefficient 

matrix and said detected object component position information: and 

means for grouping correlation values for said position marker sequence and said detected object sequence 
and generating said them position marker detection information. 

50 74. The watermark detection apparatus as claimed in claim 70. wherein said watermark detection means, comprises: 

means forcutting a pixel block from said detected object image, using said detected object component position 
information, said offset information and said key; 

means for performing a discrete Fourier transform on said pixel block and generating a detected object coef- 
55 ficient matrix; 

means for generating a detected object sequence from said offset information, said detected object coefficient 
matrix and said detected object component position information; 

means for generating symbol detection inform.ition from a value of a correlation between said detected object 
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sequence and a sequence generated from said key and symbol candidate information: 

means for using each symbol position of said symbol detection information s the basis for detecting a symbof 
when the value of the correlation is maximum; and 

means for outputting a result of conversion of said detected symbol into a watermark format. 

75. The watermark detection apparatus as claimed in claim 70. wherein said position marker sequence generation 
means comprises: 

means for. when a pixel block of a size of N x N pixels has been cut from said detected object image, in a 
case said pixel block has an empty portion, determining an average of pixel values of a portion of said pixel of said 
pixel block including said detected object image, and filling said empty portion with said average value. 

76. The watermark detection apparatus as claimed in claim 70. wherein said watermark detection means comprises: 

means for dividing a pixel block from said detected object image: 

means for performing a discrete Fourier transform on said pixel block and generating a detected object coef- 
ficient matrix: 

means for generating a detected object sequence from said offset information, said detected object coefficient 

matrix and said detected object component position component position information; 

means for generating a detected symbol from said detected object sequence and said key; and 

means for detecting a watermark from said detected symbol. 

77. The watermark detection apparatus as claimed in claim 70. wherein said watermark detection means comprises: 

means for. when a pixel block of a size of N ^ N pixels size has been cut from said detected object image, 
in a case said pixel block has an empty portion, determining an average of pixel values of a portion of said pixel 
of said pixel block including said detected object image, and filling said empty portion with said average value. 

78. The watermark detection apparatus as claimed in claim 70. wherein said watermark detection means and said 
position marker sequence generation means comprises: 

means for dividing said detected object image into blocks of N ^ N pixel size; and 

means for outputting an additional block, which is the sum of respective pixel values for all blocks, as a pixel 
block. 

79. The watermark detection apparatus as claimed in claim 78, wherein said watermark detection means and said 
position marker sequence generation means comprises: 

means for. when a pixel block of a size of N pixels size has been cut from said detected object image, 
in a case said pixel block has an empty portion, determining an average of pixel values of a portion of said pixel 
of said pixel block including said detected object image, and filling said empty portion with said average value, 

80. The watermark detection apparatus as claimed in claim 73. wherein said position marker sequence generation 
means comprises: 

means for changing said detected object sequence so that an average value of said detected object sequence 
is zero. 

81. The watermark detection apparatus as claimed in claim 74, wherein said watermark detection means, comprising: 

means for changing said detected object sequence so that an average value of said detected object sequence 
is zero. 

82. The watermark detection apparatus as claimed in claim 70. wherein said position marker detection means, com- 
prising: 

means for determining a maximum value of said position marker detection information; 

means for outputting offset detection failure information when a maximum of said position mar -r detection 
information is smaller than a required threshold value, and outputting said offset information wh^n said max- 
imum value is equal to or larger than said required threshold value. 

83. The watermark detection apparatus as claimed m claim 74 . wherein said watermark detection means further com- 
prises: 
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means for dividing, for each symbol position, said symbol detection information generated from said detected 
object sequence and said key; 

means for determining a maximum value of a sequence for each symbol position; and 

means for outputting watermark detection failure information when said maximum value is smaller than a 
required threshold value, and outputting a symbol candidate when said maximum value is equal to or larger 
than said required threshold value. 

84. The watermark detection apparatus as claimed in claim 83. wherein said required threshold value is determined 
on the basis of a value of a normal distribution function that having a average of 0 and a variance of 1 . 

85. A storage medium that stores a watermark embedding program that performs embedding of watermark so that 
the watermark is perceptible, into a digital image the program comprising; 

a process for independently changing a real number component and an imaginary number component of each 
15 coefficient value of a complex watermark sequence matrix by using a key and the watermark to be embedded 

in said digital image; 

a process for performing a discrete Fourier transform on the watermark sequence matrix that has been 
changed, and generating a watermark pattern; and 

a process for adding like tiling said watermark pattern to said digital image, and generating an embedded 
20 image. 

86. The storage medium that stores the watermark embedding program as claimed in claim 85, the program further 
comprising: 

25 an embedding object component specification process for generating from said key. embedding object com- 

ponent position information which is the component of length, width and coordinates of the sequence; 
an embedding sequence generation process for using said key to spread position marker information and said 
watermark into an embedding sequence; 

a component value change process for using said embedding object component position information and said 
30 embedding sequence to change a component value of the watermark coefficient matrix, which has a zero 

matrix as on original value; 

a discrete Fourier transform process for performing a discrete Fourier transform on said watermark coefficient 
matrix and generating said watermark pattern, and 

a watermark pattern addition process for emphasizing said watermark pattern by using an intensity parameter, 
35 adding like tiling said emphasized watermark pattern to the digital image, and generating an embedded image. 

87. The storage medium that stores the watermark embedding program as claimed in claim 86, wherein said embed- 
ding object component specification process, further comprises: 

*?o a process for generating a random number sequence that uses said key as an initial value; and 

a process for generating said embedding object component position information, using said random number 
sequence. 

45 88. The storage medium that stores a watermark embedding program as claimed in claim 86, wherein said embedding 
sequence generation process, comprises: 

a process for generating a first spread sequence having said key as an initial value, magnifying said first spread 
sequence, a required number of times and storing the magnified first spread sequence; 
50 a process for converting said watermark into a symbol expression; 

a process for obtaining a total number of symbols and a value for each symbol; 

a process for generating a second spread sequence that takes as its initial value a sum of said key and said 
symbol value; 

a process for adding said stored spread sequence to each item a sa sequence expressing symbols. 
55 a process for determining a average value of stored value, and 

a process for taking that has the average value subtracted from each item, as the embedding sequence. 

89. The storage medium that stores a watermark embedding program as claimed in claim 86. wherein said embedding 
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sequence generation process, comprising: 

a process for generating a spread sequence taking said key as the initial value. 

a process for multiplying a required parameter to said spread sequence and hold it in a storage means, 
a process for converting said'watermark into symbol expression, 

a prooess for adding a spread sequence corresponding to a symbol of said symbol expression, to each item 
of said storage means. 

a process for taking the results of subtracting a average value from each of said items of said storage means, 
as said embedding sequence. 

90. The storage medium that stores a watermark embedding program as claimed in claim 89, wherein said embedding 
sequence generation process uses either +1 or -1 as values of said first spread sequence. 

91. A storage medium that stores a watermark detection program that performs the detection of a watermark embedded 
in a detected object image which watermark cannot be sensed visually, comprising: 

a detected object component specification process for generating detected object component position infor- 
mation from key: 

a position marker sequence generation process for generating a position marker sequence from said key; 
a position marker detection process for detecting said position marker sequence, and extracting offset infor- 
mation when a start point of the embedded watermark is in agreement with a start point of a pixel block cut 
from the detected object image; and 

a watermark detection process for detecting said embedded watermark from said pixel block cut from said 
detected object image on the basis of said offset information. 

92. The storage medium that stores a watermark detection program as claimed in claim 91. wherein said detected 
object component specification process comprises: 

a process for generating a random number sequence that has said key as an initial value; and 
a process for generating said detected object component position information from said random number se- 
quence. 

93. The storage medium that stores a watermark detection program as claimed in claim 91. wherein said detected 
object specification process, comprising: 

a process for generating a O'th spread sequence taking said key as the initial value, and outputting said 
spread sequence as said position marker sequence. 

94. The storage medium that stores a watermark detection program as claimed in claim 91. wherein said position 
marker detection process, comprising: 

a process for generating offset candidate information, 

a process for cutting a pixel block from a position of said detected object image, which position is determined 
by said offset candidate information; 

a process for performing a discrete Fourier transform on said pixel block and generating a detected object 
coefficient matrix, 

a process for generating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix, 

a process for grouping said offset candidate information and correlation value for said position marker se- 
quence and said detected object sequence and generating position marker detection information, and 
a process for extracting, as said offset information, offset candidate information when the correlation value 
between said position marker sequence and said detected object sequence is maximum. 

95. The storage medium that stores a watermark detection program as claimed in claim 91 . wherein said watermark 
detection process, comprising: 

a process for cutting a pixel block of N ^ N pixels from a position of said detected object images, which position 

has undergone parallel displacement by the amount of said offset candidate information-; 

a process for performing a discrete Fourier transform on said pixel block and generating a detected object 
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coefficient matrix; 

a process for generating a detected object information from said detected object component position informa- 
tion and said detected object coefficient matrix; 

a process for generating symbol detection information from said detected object sequence and said key; 
5 a process for generating each detected symbol from said symbol detection information; and 

a process for outputting as a watermark, detection result from each detected symbol. 

96. The storage medium that stores a watermark detection program as claimed in claim 95, wherein said watermark 
detection process, further comprising: 

w 

a process for generating a sequence for each symbol position of said symbol detection information; and 
a process for selecting, as the detected symbol, a symbol candidate having maximum value in the sequence 
for said each symbol position, performing an inverse symbol transform on said detected symbol, and obtaining 
said detection result. 

15 

97. The storage medium that stores a watermark detection program as claimed in claim 91, wherein said watermark 
detection process, comprising: 

a process for outputting a pixel block cut from said detected object image by cyclic shift of said cut pixel 
block, according said offset. 

20 

98. The storage medium that stores a watermark detection program as claimed in claim 91, wherein said watermark 
detection process, comprising: 

a process for cutting pixel blocks of Nx N pixels from said detected object image when said detected object 

25 image is of an N x N size or more, 

a process for when said detected object image is smaller than said N x N size, determining an average pixel 
value for a portion of said detected object image that would have been included if said Nx N size of said 
detected object image had been cut. filling said average pixel value into a portion that does not make up said 
N x N size, and generating a pixel block; and 

30 a process for performing cyclic shift of said cut block and outputting a detection result. 

99. The storage medium that stores a watermark detection program as claimed in claim 91, wherein said watermark 
detection process, comprising: 

35 a process for dividing said detected object image into a pixel block from a position corresponding to said offset 

information; 

a process for performing a discrete Fourier transform on said divided pixel block and generating a detected 
object coefficient matrix; 

a process forgenerating a detected object sequence from said detected object component position information 
JO and said detected object coefficient matrix; 

a process forgenerating symbol detection information from said detected object sequence and said key; and 
a process for outputting a detection result corresponding to said symbol detection information. 

100. The storage medium that stores a watermark detection program as claimed in claim 91, wherein said watermark 
**5 detection process, comprising: 

a process for dividing said detected object image into pixel blocks and performing cyclic shift of said pixel 
blocks according to said offset information; 

a process for performing a discrete Fourier transform on said pixel blocks that have undergone said cyclic 
50 shift, and generating a detected object sequence matrix; 

a process forgenerating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix; 

a process forgenerating symbol detection information from said detected object sequence and said key; 
a process forgenerating each detected symbol from said symbol detection information, and 
55 a process for detecting a watermark from said each detected symbol. 

101. The storage medium that stores a watermark detection program as claimed in claim 91. wherein said watermark 
detection process, comprising: 
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a process for dividing said detected object image into pixel blocks and performing cyclic shift of said pixel 
blocks according to the offset information, wherein portions around the edges of the detected object image 
that do not make up an Nx N size pixel block, are filled with an average pixel value; 

a process for performing a discrete Fourier transform on said pixel block and generating a detected object 
5 coefficient matrix; 

a process for generating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix; 

a process for generating symbol detection information from said detected object sequence and said key; and 
a process for generating each detected symbol from said symbol detection information. 

10 

102. The storage medium that stores a watermark detection program as claimed in claim 91, wherein said position 
marker generation process, comprising: 

a process for using an offset to divide said detected object image into pixel blocks; and 
15 a process foroutputting an additional block , which is the sum of corresponding pixel value of said pixel blocks, 

as pixel block. 

103, The storage medium that stores a watermark detection program as claimed in claim 91. wherein said position 
marker generation process, comprising: 

20 

a process for dividing said detected object image into blocks; and 

a process for making a block obtained by adding pixel values of said divided blocks, into an additional block, 
performing cyclic shift of said additional block by an offset, and generation a pixel block. 

25 104. The storage medium that stores a watermark detection program as claimed in claim 102. wherein said position 
marker generation process, comprising: 

a process for dividing said detected object image into blocks and, when a block around the edge of said 
detected object image contains an empty portion, determining an average value of pixel values of the portion 
30 of the block including detected object image, and filling said empty portion with said average value; 

a process for generating an additional block by adding corresponding pixel values of said divided blocks; and 
a process for using an offset to perform cyclic shift of said additional block and generating a pixel block. 

105. The storage medium that stores a watermark detection program as claimed in claim 94, wherein said position 
35 marker generation process, further comprising: 

a process for changing said detected object sequence so that an average value of said detected object 
sequence is zero. 

106. The storage medium that stores a watermark detection program as claimed in claim 100. wherein said watermark 
40 detection process, further comprising: 

a process for changing said detected object sequence so that an average value of said detected object 
sequence is zero. 

107. The storage medium that stores a watermark detection program as claimed in claim 101 , wherein said watermark 
45 detection process, further comprising: 

a process for changing said detected object sequence so that an average value of said detected object 
sequence is zero. 

108. The storage medium that stores a watermark detection program as claimed in claim 94. wherein said position 
50 marker detection process, comprising: 

a process for determining a maximum value of said position marker detection information, and when maxi- 
mum value is smaller than a required threshold value, outputting offset detection failure information, and when 
said maximum value is equal to or greater than said required threshold value, outputting said offset information 
corresponding to said maximum value. 

55 

109. The storage medium that stores a watermark detection program as claimed in claim 95. wherein said watermark 
detection process, comprising: 
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a process for dividing symbol detection information for each symbol position and generating a sequence for 
each of said symbol positions, 

a process for determining a maximum value of said sequence for each symbol position, and when said max- 
imum value is smaller than a required threshold value. outputting watermark detection failure information, and 
when said maximum value is equal to or greater than said required threshold value, detecting a symbol cor- 
responding to said maximum value; and 

a process for converting from said detected symbol into a watermark expression. 

110. The storage medium that stores a watermark detection program as claimed in claim 109, wherein said required 
threshold value is determined on the basis of a value of normal distribution function having an average of 0 and a 
variance of 1 . 

111. A storage medium that stores a watermark detection program that detects a watermark, in a detected object image 
which watermark is imperceptible digital data visually, the program comprises: 

a detected object component specification process for generating detected object component position infor- 
mation from a key; 

a position marker sequence generation process for generating a position maker sequence from the key; 
a position marker detection process for using position marker detection information to generation offset infor- 
mation that expresses the degree to which a start point of an embedded watermark pattern is displaced from 
a start point of a pixel block cut from said detected object image: and 

a watermark detection means for using said offset information to detect a watermark embedded in said pixel 
block. 

112. The storage medium that stores a watermark detection program as claimed in claim 111, wherein said detected 
object component specification process comprises; 

a process for generating a random number sequence that has said key as an initial value; and 
a process for generating said detected object component position information from said random number se- 
quence. 

113. The storage medium that stores a watermark detection program as claimed in claim 111. wherein said position 
marker sequence generation process comprises; 

a process forgenerating a O'th spread sequence taking said key as an initial value, and outputting said spread 
sequence as said position marker sequence. 

114. The storage medium that stores a watermark detection program as claimed in claim 111, wherein said position 
marker sequence generation process comprises: 

a process for generating offset candidate information, and cutting a pixel block of a size of Nx N pixels from 
said detected object image using said detected object component position information and sid position marker 
sequence; 

a process for performing a discrete Fourier transform on said pixel block and generating a detected object 
coefficient matrix; 

a process for generating a detected object sequence from said detected object component position information 
and said detected object coefficient matrix; and 

a process for grouping correlation value for said position marker sequence and said detected object sequence 
and generating said position marker detection information. 

115. The storage medium that stores a watermark detection program as claimed in claim 111 , wherein said watermark 
detection process comprises; 

a process for cutting a pixel block ofN a N pixels from a position of said detected object image, which position 
has undergone parallel displacement by the amount of said offset candidate information; 
a process for performing a discrete Fourier transform on said pixel block and generating a detected object 
coefficient matrix, 

a process forgenerating a detected object sequence from said offset information, said detected object coef- 
ficient matrix and said detected object component position information; 



61 



EP 1 022 678 A2 



a process for generating a symbol detection information from a value of a correlation between said detected 
object sequence and a sequence generated from said key and symbol candidate information; 
a process for using each symbol position of said symbol detection information as the basis for detecting a 
symbol when the value of the correlation is maximum; and 

a process for outputting a result of conversion of said detected symbol into a watermark format. 

11 6. The storage medium that stores a watermark detection program as claimed in claim 114, wherein said position 
marker sequence generation process comprises; 

a process for, when a pixel block of N x N pixel size has been cut from said detected object image, in a case 
said pixel block has an empty portion, determining an average of pixel values of a portion of said pixel block 
including said detected object image, and filling said empty portion with said average value. 

117. The storage medium that stores a watermark detection program as claimed in claim 111 . wherein said watermark 
detection process comprises; 

a process for dividing a pixel block from said detected object image; 

a process for performing a discrete Fourier transform on said pixel block and generating a detected object 
coefficient matrix; 

a process for generating a detected object sequence from said offset information, said detected object com- 
ponent position information and said detected object coefficient matrix; 

a process for generating a detected symbol from said detected object sequence and said key; and 
a process for detecting a watermark from said detected symbol. 

11 8. The storage medium that stores a watermark detection program as claimed in claim 111 . wherein said watermark 
detection process comprises; 

a process for. when a pixel block of N ^ N pixel size has been cut from said detected object image, in a case 
said pixel block has an empty portion, determining an average of pixel values of a portion of said pixel block 
including said detected object image, and filling said empty portion with said average value. 

119. The storage medium that stores a watermark detection program as claimed in claim 111, wherein said position 
marker sequence generation process comprises: 

a process for. when a pixel block of N ^ N pixel size has been cut from said detected object image, in a case 
said pixel block has an empty portion, determining an average of pixel values of a portion of said pixel block 
including said detected object image, and filling said empty portion with said average value. 

120. The storage medium that stores a watermark detection program as claimed in claim 111 , wherein said watermark 
detection process, comprising; 

a process for dividing said detected object image into blocks of N ^ N pixel size; and 

a process for outputting. an additional block which is the sum of respective pixel values for all blocks, as a 
pixel block. 

121. The storage medium that stores a watermark detection program as claimed in claim 111 , wherein said watermark 
detection process comprises; 

a process for. when a pixel block of N ^ N pixel size has been cut from said detected object image, in a case 
said pixel block has an empty portion, determining an average of pixel values of a portion of said pixel block 
including said detected object image, and filling said empty portion with said average value. 

122. The storage medium that stores a watermark detection program as claimed in claim 111, wherein said position 
marker sequence generation process, comprising; 

a process for, when a pixel block of N ^ N pixel size has been cut from said detected object image, in a case 
said pixel block has an empty portion, determining an average of pixel values of a portion of said pixel block 
including said detected object image, and filling said empty portion with said average value. 

123. The storage medium that stores a watermark detection program as claimed in claim 122. wherein said position 
marker sequence generation process further comprises: 

a process for changing said detected object sequence so that an average value of said detected object 
sequence is zero. 
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124. The storage medium that stores a watermark detection program as claimed in claim 121 , wherein said watermark 
detection process further comprises; 

a process for changing said detected object sequence so that an average value of said detected object 
. sequence is zero. 

125. The storage medium that stores a watermark detection program as claimed in claim 111, wherein said position 
marker detection process comprises; 

a process for determining a maximum value of said a position marker detection information; 
a process for outputting offset detection failure information when a maximum value of said position marker 
detection information is smaller than a required threshold value, and outputting said offset information when 
said maximum value is equal to or larger than said required threshold value. 

126. The storage medium that stores a watermark detection program as claimed in claim 111 , wherein said watermark 
detection process further comprises; 

a process for dividing, for each symbol position, symbol detection information generated from said detected 
object sequence and said key; 

a process for determining the maximum value of a sequence for each symbol position, for each symbol position, 
and a process for outputting failure for detect of a watermark when said maximum value is smaller than a 
required threshold value; and 

a process for outputting a symbol candidate when there is said maximum value, in cases when said maximum 
value is equal to or larger than a required threshold value. 

127. The storage medium that stores a watermark detection program as claimed in claim 115, wherein said watermark 
detection process comprises; 

a process for dividing for each symbol position, symbol detection information generated from said detected 
object sequence and said key; 

a process for determining the maximum value of a sequence for each symbol position, foreach symbol position; 
and 

a process for outputting failure for detect of a watermark when said maximum value is smaller than a required 
threshold value, and a process for outputting a symbol candidate when there is said maximum value, in cases 
when said maximum value is equal to or larger than required threshold value. 

128. The storage medium that stores a watermark detection program as claimed in claim 127, wherein said threshold 
value uses a threshold value determined on the basis of a value of a distribution function that is a normal distribution 
having an average of 0 and a variance of 1 . 

129. The storage medium that stores a watermark detection program as claimed in claim 128. wherein said threshold 
value uses a threshold value determined on the basis of a value of a distribution function that is a normal distribution 
having an average of 0 and a variance of 1 . 

130. A watermark system comprising a watermark embedding apparatus that embeds a watermark into a digital image 
so that the watermark is visually imperceptible digital data, and a watermark detection apparatus. 

said watermark embedding apparatus comprising: 

embedding object component specification means for generating from a key embedding object component 
position information which is a sequence that is the component of length, width and corrdinates of the se- 
quence; 

embedding sequence generation means for using said key to spread position marker information and said 
watermark into an embedding sequence; 

component value change means for changing a complex watermark coefficient matrix having a zero matrix 
as an initial value using said embedding object component position information and said embedding sequence; 
discrete Fourier transform means for performing a discrete Fourier transform on said changed watermark 
coefficient matrix, and generating a watermark pattern; and 

watermark pattern addition means for emphasizing said watermark pattern by using an intensity parameter, 
and generating an embedded image obtained by adding like tiling said emphasized watermark pattern to the 
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digital image, 

said watermark detection apparatus comprising: 

detected object component specification means for generating detected object component position information 
from key; 

position marker sequence generation means for generating a position marker sequence from said key, 
position marker detection means for detecting a position marker sequence, and extracting offset information 
that expresses when a start point of a watermark pattern upon embedding is in agreement with a start point 
of a pixel block cut from a detected object image; and 

watermark detection means for detecting said watermark from embedded in cut said pixel block according to 
said offset information. 

131. The watermark system comprising a watermark embedding apparatus and a watermark detection apparatus, as 
claimed in claim 130 wherein said watermark embedding apparatus configured from an integrated circuit. 

132. The watermark system comprising a watermark embedding apparatus and a watermark detection apparatus, as 
claimed in claim 130 wherein said watermark detection apparatus configured from an integrated circuit. 

133. A watermark system comprising a watermark embedding apparatus that embeds watermark into a digital image 
which watermark is visually imperceptible digital data, and a watermark detection apparatus for detecting an em- 
bedded watermark in a detected object image, 

said watermark embedding apparatus comprising; 

embedding object component specification means for generating from said key embedding object component 
position information which is the component of length, width and corrdinates of the sequence; 
embedding sequence generation means for spreading position marker information and said watermark to an 
embedding sequence according to said key; 

component value change means for changing a watermark coefficient matrix that is a complex matrix having 
zero matrix as the initial value according to said embedding object component position information and said 
embedding sequence; 

discrete Fourier transform means for performing a discrete Fourier transform on said changed watermark 
coefficient matrix, and generating said watermark pattern; and 

watermark pattern addition means for emphasizing said watermark according to an intensity parameter, and 
generating said embedded image obtained by adding like tiling said emphasized watermark pattern to the 
input image; 

said watermark detection apparatus comprising; 

detected object component specification means for generating detected object component position information 
from the key; 

position marker sequence generation means for generating a position marker sequence from the key; 
position marker detection means for detecting offset information that expresses the degree to which a start 
point of the embedded watermark is displaced from a start point of a pixel block cut from the detected object 
image according to detected said position marker detection information; and 

watermark detection means for detecting said embedded watermark from said pixel block cut from said de- 
tected object image on the basis of said offset information. 

134. The watermark system comprising a watermark embedding apparatus and a watermark detection apparatus, as 
claimed in claim 133 wherein said watermark embedding apparatus configured from an integrated circuit. 

135. The watermark system comprising a watermark embedding apparatus and a watermark detection apparatus, as 
claimed in claim 133 wherein said watermark detection apparatus configured from an integrated circuit. 

136. A watermark embedding method that embeds a watermark in a digital image which watermark is visually imper- 
ceptible digital data, the method comprising; 

a step for determining a degree of local image complexity; and 

a step for changing complex portions of said image more than low complex degree portions in accordance 
with a degree of local image complexity, and for generating said degree of local image complexity having a 
large value for a texture region, small value for flat regions and edge portions. 
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137. The watermark embedding method as claimed in claim 136, wherein comprisesis 

a step for measuring an edge and a texture region for same grade when a difference between an input image, 
each pixel and adjacent pixels is equal to or greater than a required threshold by a incremental counter. 

5 138. The watermark embedding method as claimed in claim 137. wherein comprises; 

a step for obtaining an edge/texture component value image by measuring said edge and said texture region 
for same grade; 

a step for dividing said edge/texture component value into small blocks; 
w a step for determining the sum of edge/texture component values in said block for each divided block; and 

a step for making said sum as a texture degree index for said block. 

139. The watermark embedding method as claimed in claim 137. wherein comprises; 

75 a step for obtaining an edge/texture component value image by measuring said edge and said texture region 

for same grade; 

a step for dividing said edge/texture component value into small blocks; 

a step for determining the sum of edge/texture component values in said block for each divided block; and 
a step for making value which is said sum mapped by a predetermined function as the texture degree index 
20 of said block. 

140. The watermark embedding method as claimed in claim 138. wherein comprises; 

a step for dividing said edge/texture component value into small blocks according to said edge/texture com- 
25 ponent value and said texture region; 

a step for multiplying a texture degree index corresponding to each edge/texture component value in a divided 
block, and obtaining texture component value image. 

141. The watermark embedding method as claimed in claim 139. wherein comprises; 

30 

a step for dividing said edge/texture component value into small blocks according to said edge/texture com- 
ponent value and said texture region; and 

a step for multiplying a texture degree index corresponding to each edge/texture component value in a divided 
block, and obtaining texture component value image. 

35 

142. The watermark embedding method as claimed in claim 136. wherein said step for changing complex portions of 
said image more than it does not complex portions in accordance with said degree of local image complexity 
comprises; 

when a differential between an input image, each pixel and adjacent pixel is equal to orgreaterthan a required 
•to threshold, uses the value of an incremental counter according to obtain an edge/texture component value image 

by measuring edge and a texture region for same grade, as a degree of local image complexity, and uses said 
edge/texture component value image as a degree of local image complexity. 

143. The watermark embedding method as claimed in claim 136. wherein said step for changing complex portions of 
45 said image more than low complex degree portions in accordance with said degree of local image complexity 

comprises; 

a step for dividing said edge/texture component value image which obtained by measuring said edge and said 
texture region for same grade into small blocks; 
so a step for determining the sum of edge/texuture component value in said block for each of divided blocks and 

using said sum as said block texture degree index: and 

a step for up-sampling said texture degree index and using it as a degree of local image complexity. 

144The watermark embedding method as claimed in claim 136. wherein said step for changing complex portions of 
55 said image more than low complex degree portions in accordance with said degree of local image complexity 

comprises; 

a step for dividing said edge/texture comp'-m-rnt value image which obtained by measuring said edge and said 
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texture region for same grade into small blocks; 

a step for determining the sum of edge/texuture component value in said block for each divided blocks antf 
making a texture degree index of said that is mapped said sum by a predetermined function; and 
a step for up-sampling said texture degree index and using it as a degree of local image complexity. 

145. The watermark embedding method as claimed in claim 136, wherein said step for changing complex portions of 
said image more than low complex degree portions in accordance with said degree of local image complexity 
comprises; 

a step for dividing said edge/texture values into small blocks according to said edge/texture value image and 
said texture degree index as a degree of local image complexity; 

a step for multiplying a texture degree index corresponding to each edge/texture value in a divided block to 
obtain a texture component value image; and 

a step for using said texture component value image as a degree of local image complexity. 

146. A watermark embedding method that embeds a watermark which is visually imperceptible digital data, into a digital 
image comprises; 

a step for generating a degree of local image complexity that is a image; 

a step for generating a watermark pattern from a watermark using key necessary for embedding a watermark; 
a step for adding said watermark pattern to said input image in accordance with a degree of local image 
complexity; and 

a step for generating an image that has embedded said watermark. 

147. The watermark embedding method as claimed in claim 146, wherein when a degree of local image complexity is 
generated from said image, 

a difference between each pixel of said input image and adjacent pixels in incremented by a differential counter 
when it is larger than a predetermined threshold value, and a value of a differential counter when processing 
has finished for adjacent pixels is made into the edge/texture component value image; and 
said edge/textue component value image is made the degree of local image complexity. 

148. The watermark embedding method as claimed in claim 146, wherein when a degree of local image complexity is 
generated from said image, 

a difference between each pixel of said input image and adjacent pixels in incremented by a differential counter 
when it is larger than a predetermined threshold value, and a value of a differential counter when processing 
has finished for adjacent pixels is made into the edge/texture component value image; 

said edge/texture component image is divided into small blocks and the sum of the edge/texture component 
values for said block is taken and made a texture degree index for said block; and 
said texture degree index is up-sampled and made a degree of local image complexity. 

149. The watermark embedding method as claimed in claim 146, wherein when a degree of local image complexity is 
generated from said image. 

a difference between each pixel of said input image and adjacent pixels in incremented by a differential counter 
when it is larger than a predetermined threshold value, and a value of a differential counter when processing 
has finished for adjacent pixels is made into the edge/texture component value image; 

said edge/texture component image is divided into small blocks and the sum of the edge/texture component 
values for said block is taken and made a texture degree index for said block; and 

said texture degree index is multiplied by an edge/texture component image for each of said blocks and a 
texture component value image obtained which is made the degree of local image complexity. 

150. A watermark embedding method that embeds a watermark in a digital image which watermark is visually imper- 
ceptible digital data, the method comprises: 

a step for dividing an input image that is >.;ti«1 digital image, into blocks of a required size and generating a 
degree of local image complexity; 
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a step for generating a basic watermark pattern that pattern the base of a watermark using key necessary for 
embedding; 

a step for generating an adaptive watermark pattern emphasized by an orthogonal transform coefficient cor- 
responding to said basic watermark pattern and in accordance with a value of an amplitude of an orthogonal 
5 transform coefficient for said olock: and 

a step for adding said basic pattern and said watermark pattern to said block in accordance with an intensity 
parameter and a degree of local image complexity, and generating an image having embedded information. 

151. The watermark embedding method as claimed in claim 150. wherein a difference between an adjacent pixel and 
10 each pixel of said input image is incremented by a differential counter when it is larger than a predetermined 

threshold value, and a value of a differential counter when processing has finished for adjacent pixels is made into 
the edge/texture component value image; and 

said edge/texture component image is made a degree of local image complexity. 

15 1 52. The watermark embedding method as claimed in claim 1 50. wherein a difference between an adjacent pixel and 
each pixel of said input image is incremented by differential counterwhen it is largerthan a predetermined threshold 
value, and a value of a differential counter when processing has finished for adjacent pixels is made into the edge/ 
texture component value image; 

20 said edge/texture component image is divided into small blocks and the sum of the edge/texture component 

value for said block is taken and made a texture degree index for said block; and 
said texture degree index is up-sampled and made a degree of local image complexity. 

153. The watermark embedding method as claimed in claim 152. wherein a value obtained by mapped said texture 
25 degree index created from said edge/texture component value image, by a predetermined function is made the 

texture degree index. 

154. The watermark embedding method as claimed in claim 150. wherein a difference between each pixel of said input 
image and adjacent pixels in incremented by a differential counter when it is larger than a predetermined threshold 

30 value, and a value of a differential counterwhen processing has finished of adjacent pixels is made into the edge/ 

texture component value image; 

said edge/texture component image is divided into small blocks and the sum of the edge/texture component 
values for said block is taken and made a texture degree index for said block; and 
35 said texture degree index multiplied to an edge/texuture component image for each block and a texture com- 

ponent value image obtained, which is made the degree of local image complexity. 

155. A watermark embedding apparatus that embeds a watermark in a digital image which watermark is visually im- 
perceptible digital data, the apparatus comprising: 

40 

degree of local image complexity generation means for inputting an input image as its input and determining 
a degree of local image complexity; 

watermark pattern generation means for generating a pattern that expresses said watermark using necessary 
key upon embedding; 

45 image addition means for adding a pattern generated by said watermark pattern generation means, and a 

degree of local image complexity, to said input image, and generating a watermark embedded image. 

156. The watermark embedding apparatus as claimed in claim 155. wherein said degree of local image complexity 
generation means comprises; 



50 
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means for performing increment a differential counter when a difference between an adjacent pixel and each 
pixel of said input image is larger than a predetermined threshold value, and taking a value of a differential 
counter as an edge/texture value image when processing is finished for adjacent pixels; and 
means for making said edge/texture component value image into a degree of local image complexity. 

157. The watermark embedding apparatus as claimed in claim 155. wherein said degree of local image complexity 
generation means comprises; 
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means for performing increment a differential counter when a difference between an adjacent pixel and each 

pixel of said input image is larger than a predetermined threshold value, and taking a value of a differential 

counter as an edge/texture value image when processing is finished for adjacent pixels; 

means for dividing said edge/texture component image into small blocks and taking a sum of edge/texture 

component value of said block and make it a texture degree index of said block: and 

means for up-sampling said texture degree index and making it a degree of local image complexity. 

158. The watermark embedding apparatus as claimed in claim 155, wherein said degree of local image complexity 
generation means comprises; 

means for generating an edge/texture component value image from said input image, 

means for generating a texture degree index from said edge/texture component value image, and 

means for mapping said texture degree index using a predetermined function, and making a degree of local 

image complexity. 

159. The watermark embedding apparatus as claimed in claim 155. wherein said degree of local image complexity 
generation means comprises; 

means for performing increment a differentia! counter when a difference between an adjacent pixel and each 

pixel of said input image is larger than a predetermined threshold value, and taking a value of a differential 

counter as an edge/texture value image when processing is finished for adjacent pixels; 

means for dividing said edge/texture component image into small blocks, and taking a sum of edge/texture 

component values of said block, and making it a texture degree index of said block; and 

means for multiplying said texture degree index with an edge/texture component image for each block, and 

obtaining a texture component value image which it makes the degree of local image complexity. 

1 60. A watermark embedding apparatus that embeds a watermark in a digital image which watermark is visually im- 
perceptible digital data, comprises; 

block division means for inputting input image that is digital image, and dividing it into blocks of required size; 
watermark pattern generation means for generating a basic watermark pattern that expresses said digital 
watermark using key and watermark embedded in said input image; 

adaptive watermark pattern generation means for generating an adaptive watermark pattern emphasized by 
an orthogonal transform coefficient corresponding to said basic watermark pattern and in accordance with 
value of an amplitude of an orthogonal transform coefficient for a block divided by said block division means; 
degree of local image complexity generation means for determining a degree of local image complexity using 
said block; and 

adding means for adding said basic pattern and said adaptive watermark pattern for each block in accordance 
with an intensity parameter that express the strength of embedding, and a degree of local image complexity, 
and generating an image having embedded information. 

161. The watermark embedding apparatus as claimed in claim 160 wherein said degree of local image complexity 
generation means comprises; 

r 

means for performing increment a differential counter in cases when a difference between an adjacent pixel 
and each pixel of said input image is larger than a predetermined threshold value, and taking a value of dif- 
ferential counter when processing has finished for adjacent pixels as the edge/texture component value image; 
and 

means for taking said texture degree index as a degree of local image complexity. 

162. The watermark embedding apparatus as claimed in claim 160 wherein said degree of local image complexity 
generation means comprises; 

means for performing increment a differential counter in cases when a difference between an an adjacent pixel 
and each pixel of said input image is larger than a predetermined threshold value, and taking a value of a 
differential counter when processing has finished for adjacent pixels as the edge/texture component value 
image; 

means for dividing said edge/texture component image into small blocks: 
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means for performing the sum of the edge/texture component values for said block, and making a texture 
degree index for said block; and 

means for up-sampling said texture degree index and making result of up-sampling to a degree of local image 
complexity. 

5 

163. The watermark embedding apparatus as claimed in claim 160 wherein said degree of local image complexity 
generation means comprises; 

means for generating an edge/texture component value image from said input image; 
w means for creating a texture degree index from said edge/texture component value image; and 

means for mapping said texture degree index according to a predetermined function, and making a degree of 
local image complexity. 

164. The watermark embedding apparatus as claimed in claim 160 wherein said degree of local image complexity 
i5 generation means comprises; 

means for performing increment a differential counter when a difference between each pixel of said input image 
and adjacent pixel is larger than a predetermined threshold value, and taking a value of a differential counter 
when processing has finished for adjacent pixels as the edge/texture component value image; 
20 means for dividing said edge/texture component image is into small blocks, and taking the sum of the edge/ 

texture component values for said block is taken as a texture degree index for said block; and 
means for multiplying said texture degree index to each edge/texuture component image for each block, and 
obtaining a texture component value image and making said texture component value image as the degree 
of local image complexity. 

25 

165. The watermark embedding apparatus as claimed in claim 155. configured from an integrated circuit. 

166. The watermark embedding apparatus as claimed in claim 160, configured from an integrated circuit. 

30 167. A storage medium that stores a watermark embedding program that embeds watermark into a digital image which 
watermark is visually imperceptible digital data, the program comprising; 

a degree of local image complexity generation process for inputting an input image as its input and determining 
a degree of local image complexity; 
35 a watermark pattern generation process for generating a pattern that expresses said watermark using neces- 

sary key upon embedding; 

an image addition process for adding a pattern generated by said watermark .pattern generation process, and 
a degree of local image complexity, to said input image and generating a watermark embedded image. 

168. The storage medium that stores a watermark embedding program as claimed in claim 167, wherein said degree 
of local image complexity generation process comprising: 

a process for performing increment a differential counter when a difference between an adjacent pixel and 
each pixel of said input image is larger than a predetermined threshold value, and taking a value of a differential 
45 counter as an edge/texture value image when processing is finished for adjacent pixels; and 

a process for making said edge/texture component value image into a degree of local image complexity. 

169. The storage medium that stores a watermark embedding program as claimed in claim 167. wherein said degree 
of local image complexity generation process comprising: 

50 

a process for performing increment a differential counter when a difference between an adjacent pixel and 
each pixel of said input image is larger than a predetermined threshold value, and taking a value of a differential 
counter as an edge/texture value image when processing is finished for adjacent pixels; 

a process for dividing said edge/texture component image into small blocks and taking a sum of edge/texture 
55 component value of said block and making S3id sum as a texture degree index of said block; and 

a process for up-sampling said texture degree index, and making it a degree of local image complexity. 

170. The storage medium that stores a watermark embedding program as claimed in claim 167. wherein said degree 
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of local image complexity generation process comprising: 

a process for generating an edge/texture component value image from said input image; 
a process for generating a texture degree index from said edge/texture component value image; and 
5 a process for mapping said texture degree index using a predetermined function, and making a degree of local 

image complexity. 

171. The storage medium that stores a watermark embedding program as claimed in claim 167, wherein said degree 
of local image complexity generation process comprising: 

10 

a process for performing increment a differential counter when a difference between an adjacent pixel and 
each pixel of said input image is larger than a predetermined threshold value, and taking a value of a differential 
counter as an edge/texture value image when processing is finished for adjacent pixels; 
a process for dividing said edge/texture component image into small blocks and taking a sum of edge/texture 
15 component values of said block and making it a texture degree index of said block; and 

a process for multiplying said texture degree index with an edge/texture component image for each block and 
obtaining a texture component value image which it makes the degree of local image complexity. 

172. A storage medium that stores a watermark embedding program that embeds watermark so that information of 
20 contents is visually imperceptible digital data, into a digital image comprising: 

a block division process for inputting input image that is digital image, and dividing it into blocks of required size; 
a basic watermark pattern generation process for generating a basic watermark pattern that expresses said 
digital watermark using key and watermark embedded in said input image; 
25 an adaptive watermark pattern generation process for generating an adaptive watermark pattern emphasized 

by an orthogonal" transform coefficient corresponding to said basic watermark pattern and in accordance with 
value of an amplitude of an orthogonal transform coefficient for a block divided by said block division process; 
a degree of local image complexity generation process for determining a degree of local image complexity 
using said block; 

30 a adding process for adding said basic pattern and said adaptive watermark pattern for each block in accord- 

ance with an intensity parameter that express the strength of embedding, and a degree of local image com- 
plexity, and generating an image having embedded information. 

173. The storage medium that stores a watermark embedding program as claimed in claim 172 wherein said degree 
35 of local image complexity generation process comprising: 

a process for performing increment a differential counter in cases when a difference between an adjacent pixel 
and each pixel of said input image is larger than a predetermined threshold value, and taking a value of dif- 
ferential counter when processing has finished for adjacent pixels as the edge/texture component value image; 
40 and 

a process for taking said texture degree index as a degree of local image complexity. 

174. The storage medium that stores a watermark embedding program as claimed in claim 172 wherein said degree 
of local image complexity generation process comprising: 

45 

a process for performing increment a differential counter in cases when a difference between an an adjacent 
pixel and each pixel of said input image is larger than a predetermined threshold value, and taking a value of 
a differential counter when processing has finished for adjacent pixels as the edge/texture component value 
image; 

jo a process for dividing said edge/texture component image into small blocks; 

a process for performing the sum of the edge/texture component values for said block, and making said sum 
as a texture degree index for said block; and 

a process for up-sampling said texture degree index, and making result of up-sampling to a degree of local 
image complexity. 

55 

175. The storage medium that stores a watermark embedding program as claimed in claim 172 wherein said degree 
of local image complexity generation process comprising: 
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a process for generating an edge/texture component value image from said input image; 

a process for creating a texture degree index from said edge/texture component value image; and 

a process for mapping said texture degree index according to a predetermined function, and making a degree 

of local image complexity. 

5 

176. The storage medium that stores a watermark embedding program as claimed in claim 172 wherein said degree 
of local image complexity generation process comprising; 

a process for performing increment a differential counter when a difference between each pixel of said input 
10 image and adjacent pixel is larger than a predetermined threshold value, and taking a value of a differential 

counter when processing has finished for adjacent pixels as the edge/texture component value image; 
a process for dividing said edge/texture component image is into small blocks, and taking the sum oi" the edge/ 
texture component values for said block is taken as a texture degree index for said block; and 
a process for obtaining a texture component value image by multiplying said texture degree index to each 
15 edge/texuture component imagefor each block, and making said texture component value image as the degree 

of local image complexity. 
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